00000001:02000400:0.0F:1787432274.351050:0:3298:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787432293.853918:0:3516:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1787432295.800654:0:3581:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 699 MB/s 00000001:01000000:3.0:1787432296.051776:0:3581:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 601 MB/s 00000001:01000000:3.0:1787432296.301265:0:3581:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4663 MB/s 00000020:02000000:1.0F:1787432297.348149:0:3610:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_63_gaeb0ce0 00000400:02000000:3.0:1787432298.234609:0:3625:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.124@tcp [8/256/0/180] 00008000:02000000:3.0:1787432301.854297:0:3775:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1787432361.499548:0:5740:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787432375.306066:0:6490:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787432375.306073:0:6490:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787432375.306074:0:6490:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787432375.306347:0:6490:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000da5e5c70 00000080:02000400:3.0:1787432375.306420:0:6490:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787432375.322136:0:6490:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787432375.322151:0:6490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787432375.322218:0:6490:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000545bd61d) 00000020:00000080:3.0:1787432375.322237:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0F:1787432375.392102:0:6490:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787432375.392206:0:6490:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1787432375.430052:0:6490:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787432375.430296:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787432375.430304:0:6490:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787432375.430318:0:6490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33563e66b 00000020:01000004:1.0:1787432375.430325:0:6490:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1787432375.430330:0:6490:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787432375.430334:0:6490:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000da5e5c70 from MGS 00000020:01000004:1.0:1787432375.430339:0:6490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787432375.430358:0:6490:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000009401e504) 00000020:00000080:1.0:1787432375.430368:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787432375.430440:0:6490:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000da5e5c70 from MGS, refs=2 00080000:01000000:1.0:1787432375.430445:0:6490:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787432375.430452:0:6490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33563e679 00000100:00100000:1.0:1787432375.430544:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787432375.430683:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787432375.430690:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787432375.431256:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787432375.431263:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787432375.432523:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787432375.434125:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787432375.434137:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787432375.443041:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787432375.443065:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787432375.448672:0:6490:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787432375.449854:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787432375.456697:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432375.456703:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432375.456705:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432375.456953:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432375.456956:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432375.456957:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432375.457543:0:6490:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787432375.459707:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787432375.708086:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2611 MB/s 00000001:01000000:3.0:1787432375.957281:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4391 MB/s 00000001:01000000:2.0:1787432376.207402:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 763 MB/s 00000001:01000000:0.0:1787432376.459525:0:6490:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 757 MB/s 00080000:10000000:0.0:1787432376.474824:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1787432376.494634:0:6490:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787432376.497747:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787432376.497838:0:6490:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787432376.497901:0:6490:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787432376.498514:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787432376.498544:0:6490:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787432376.501018:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432376.502909:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787432376.502918:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787432376.503936:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787432376.503953:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787432376.513462:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787432376.513479:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787432376.519564:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787432376.519590:0:6490:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.124@tcp' 00000020:01000004:0.0:1787432376.519591:0:6490:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787432376.519645:0:6490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.124@tcp (typ=mgc) 00000020:00000080:0.0:1787432376.519676:0:6490:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.124@tcp (00000000f3100156) 00000020:00000080:0.0:1787432376.519696:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787432376.519834:0:6490:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000043c450d6@MGC192.168.204.124@tcp: add connection 192.168.204.124@tcp at head 00010000:00010000:0.0:1787432376.519998:0:6490:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.124@tcp-0 is initialized 00000040:01000000:0.0:1787432376.520005:0:6490:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.124@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787432376.523323:0:6509:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787432376.525376:0:6511:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787432376.526501:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.124@tcp (uuid d0f84c3f-71b4-4eda-b290-0af337217d3a) 00000020:00000080:2.0:1787432376.527217:0:6490:0:(genops.c:1385:class_connect()) connect: client d0f84c3f-71b4-4eda-b290-0af337217d3a, cookie 0xca72b3b33563e687 00000100:00080000:2.0:1787432376.527231:0:6490:0:(import.c:510:import_select_connection()) MGC192.168.204.124@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787432376.527236:0:6490:0:(import.c:624:import_select_connection()) MGC192.168.204.124@tcp: import 0000000043c450d6 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432376.527289:0:6490:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004944603b x1874258609307776/t0(0) o250->MGC192.168.204.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432376.527313:0:6490:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d0f84c3f-71b4-4eda-b290-0af337217d3a->MGS 00000020:01000004:2.0:1787432376.527338:0:6490:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787432376.527344:0:6490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787432376.527364:0:6490:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000007c3aac8) 00000020:00000080:2.0:1787432376.527377:0:6490:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00010000:00010000:3.0:1787432376.528019:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432376.530219:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004944603b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d0f84c3f-71b4-4eda-b290-0af337217d3a:3640:1874258609307776:0@lo:250: 00000100:00100000:1.0:1787432376.530325:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432376.539191:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609307776 00000100:00100000:0.0:1787432376.539207:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609307776 00000100:00100000:0.0:1787432376.539258:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432376.541278:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cb13c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1874258609307776:12345-0@lo:250: 00010000:00080000:0.0:1787432376.541313:0:6506:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d0f84c3f-71b4-4eda-b290-0af337217d3a@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:0.0:1787432376.541346:0:6506:0:(genops.c:1385:class_connect()) connect: client d0f84c3f-71b4-4eda-b290-0af337217d3a, cookie 0xca72b3b33563e695 00000100:00080000:0.0:1787432376.541523:0:6506:0:(import.c:65:import_set_state_nolock()) 00000000af95351c : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432376.541628:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cb13c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+5:3640:x1874258609307776:12345-0@lo:250: Request processed in 2361us (11303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432376.541639:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432376.541738:0:3640:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.124@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787432376.541749:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.124@tcp: connect to target with instance 0 00000100:00080000:0.0:1787432376.541757:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.124@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787432376.541762:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787432376.541765:0:3640:0:(import.c:65:import_set_state_nolock()) 0000000043c450d6 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787432376.541768:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787432376.541779:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787432376.541784:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004944603b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d0f84c3f-71b4-4eda-b290-0af337217d3a:3640:1874258609307776:0@lo:250: 00000100:00100000:2.0:1787432376.543919:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432376.544129:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787432376.544137:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787432376.554669:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787432376.554683:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787432376.557130:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787432376.557147:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787432376.558705:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432376.559339:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787432376.559344:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787432376.566497:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787432376.566517:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787432376.638991:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432376.639306:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787432376.639311:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787432376.642063:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787432376.642077:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787432376.642690:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787432376.643243:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787432376.643249:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787432376.643925:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787432376.643933:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787432376.644646:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432376.644813:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787432376.644824:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787432376.645453:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787432376.645460:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787432376.650911:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432376.651120:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787432376.651128:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787432376.651835:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787432376.651843:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787432376.681088:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432376.681344:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787432376.681352:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787432376.684489:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787432376.684503:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787432376.687121:0:6490:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787432376.690514:0:6490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787432376.692064:0:6490:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787432376.692097:0:6490:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1787432376.692111:0:6490:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.124@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787432376.692322:0:6490:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.124@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787432376.692375:0:6490:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.124@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787432376.692379:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787432376.692381:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787432376.692383:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787432376.692384:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787432376.692385:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787432376.692386:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787432376.692388:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787432376.692390:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787432376.692391:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787432376.692392:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787432376.692393:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787432376.692395:0:6490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787432376.692397:0:6490:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787432376.692399:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787432376.692405:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787432376.692406:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787432376.692407:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787432376.692408:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787432376.692409:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787432376.692410:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787432376.692411:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787432376.692412:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787432376.692413:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787432376.692413:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787432376.692414:0:6490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787432376.692454:0:6490:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787432376.692472:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc0e44a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609307904:0@lo:253: 00000100:00100000:0.0:1787432376.692544:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432376.692601:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000787a89a6 going to sleep for 11 seconds 00000100:00100000:2.0:1787432376.692767:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609307904 00000100:00100000:2.0:1787432376.692775:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609307904 00000100:00100000:2.0:1787432376.692863:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432376.692873:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed2910f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+5:6490:x1874258609307904:12345-0@lo:253: 20000000:01000000:2.0:1787432376.692928:0:6508:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787432376.692931:0:6508:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787432376.693322:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787432376.693374:0:6508:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787432376.693638:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432376.694561:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787432376.694965:0:6508:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787432376.694969:0:6508:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787432376.694975:0:6508:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787432376.694985:0:6508:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787432376.694999:0:6508:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787432376.695236:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787432376.695435:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787432376.695449:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787432376.695479:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787432376.695495:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787432376.695509:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787432376.695560:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787432376.695567:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787432376.695579:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787432376.695583:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787432376.695594:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787432376.695598:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787432376.695608:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787432376.695633:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787432376.695661:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787432376.695666:0:6508:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787432376.695673:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787432376.697095:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787432376.697115:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787432376.697140:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787432376.697153:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787432376.697191:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787432376.697202:0:6508:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787432376.697232:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787432376.697238:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787432376.697248:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787432376.697259:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787432376.697270:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787432376.697276:0:6508:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787432376.697292:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787432376.697304:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787432376.697316:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787432376.697328:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787432376.697382:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787432376.697404:0:6508:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787432376.697411:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787432376.700389:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787432376.700654:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787432376.700682:0:6508:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.124@tcp for mdt 20000000:01000000:0.0:1787432376.700684:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.124@tcp (null) (null) (null) 00000040:00080000:0.0:1787432376.700700:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787432376.700707:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787432376.700720:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787432376.700738:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.124@tcp (null) (null) 00000040:00080000:0.0:1787432376.700754:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787432376.700761:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787432376.700787:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787432376.700803:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787432376.700832:0:6508:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787432376.700835:0:6508:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787432376.700839:0:6508:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787432376.700884:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787432376.700887:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787432376.701660:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1787432376.701929:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787432376.701964:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1787432376.701977:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1787432376.701988:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787432376.701990:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787432376.712260:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787432376.712589:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787432376.712618:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787432376.712634:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1787432376.712646:0:6508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787432376.712648:0:6508:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1787432376.712653:0:6508:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787432376.712656:0:6508:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787432376.712661:0:6508:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787432376.712668:0:6508:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787432376.713700:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1787432376.716456:0:6508:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787432376.729785:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787432376.729827:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787432376.729844:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787432376.729863:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787432376.729884:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003a0dab2d/0xca72b3b33563e69c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.729900:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003a0dab2d/0xca72b3b33563e69c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.729910:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003a0dab2d/0xca72b3b33563e69c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.729916:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003a0dab2d/0xca72b3b33563e69c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.729922:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003a0dab2d/0xca72b3b33563e69c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.729928:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003a0dab2d/0xca72b3b33563e69c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.729944:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003a0dab2d already unused, calling callback (0000000033074501) 00010000:00010000:0.0:1787432376.729948:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003a0dab2d/0xca72b3b33563e69c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.729956:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003a0dab2d/0xca72b3b33563e69c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.729966:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003a0dab2d/0xca72b3b33563e69c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.729972:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003a0dab2d/0xca72b3b33563e69c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.729990:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003a0dab2d/0xca72b3b33563e69c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787432376.730010:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787432376.748049:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed2910f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+5:6490:x1874258609307904:12345-0@lo:253: Request processed in 55168us (55496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432376.748067:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432376.748225:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc0e44a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609307904:0@lo:253: 10000000:01000000:2.0:1787432376.748241:0:6490:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787432376.748244:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787432376.748246:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787432376.748247:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432376.748248:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787432376.748249:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432376.748251:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432376.748252:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787432376.748253:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787432376.748255:0:6490:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787432376.748256:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432376.748257:0:6490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787432376.748278:0:6490:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000da5e5c70 from lustre-MDT0000 10000000:01000000:2.0:1787432376.748309:0:6490:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787432376.748312:0:6490:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787432376.748316:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9484336199b8 10000000:01000000:2.0:1787432376.748320:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787432376.748327:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9484336199b8 from 1 10000000:01000000:2.0:1787432376.748330:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787432376.748365:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e6a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.748376:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e6a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.748385:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e6a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432376.748420:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609308032:0@lo:101: 00000100:00100000:2.0:1787432376.748456:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432376.748503:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e34817ec going to sleep for 11 seconds 00000100:00100000:0.0:1787432376.748586:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609308032 00000100:00100000:0.0:1787432376.748593:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609308032 00000100:00100000:3.0:1787432376.748718:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787432376.748827:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b76fc81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+5:6490:x1874258609308032:12345-0@lo:101: 00010000:00010000:3.0:1787432376.748839:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432376.748852:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eda33c0a/0xca72b3b33563e6aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e6a3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432376.748873:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eda33c0a/0xca72b3b33563e6aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e6a3 expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432376.748882:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eda33c0a/0xca72b3b33563e6aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e6a3 expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432376.748890:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eda33c0a, rc 0) 00000100:00100000:3.0:1787432376.748957:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b76fc81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+6:6490:x1874258609308032:12345-0@lo:101: Request processed in 135us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432376.748964:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787432376.749038:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609308032:0@lo:101: 00010000:00010000:2.0:1787432376.749052:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e6a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e6aa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.749060:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e6a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e6aa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432376.749121:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609308160:0@lo:501: 00000100:00100000:2.0:1787432376.749147:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432376.749195:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e34817ec going to sleep for 11 seconds 00000100:00100000:3.0:1787432376.749247:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609308160 00000100:00100000:3.0:1787432376.749252:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609308160 00000100:00100000:3.0:1787432376.749281:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432376.749289:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ff6f9be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+6:6490:x1874258609308160:12345-0@lo:501: 00000100:00100000:3.0:1787432376.749353:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ff6f9be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+6:6490:x1874258609308160:12345-0@lo:501: Request processed in 65us (206us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787432376.749360:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787432376.749423:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609308160:0@lo:501: 10000000:01000000:2.0:1787432376.749451:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787432376.749470:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e6a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e6aa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.749478:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e6a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e6aa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432376.749485:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff948411b1c000 10000000:01000000:2.0:1787432376.749489:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787432376.749492:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff948411b1c000 10000000:01000000:2.0:1787432376.749494:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787432376.749497:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff948411b1c000 from 1 10000000:01000000:2.0:1787432376.749504:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787432376.749518:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 00000000823d4c0a/0xca72b3b33563e6b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.749524:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 00000000823d4c0a/0xca72b3b33563e6b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.749531:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 00000000823d4c0a/0xca72b3b33563e6b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432376.749542:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609308288:0@lo:101: 00000100:00100000:2.0:1787432376.749566:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432376.749582:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e34817ec going to sleep for 11 seconds 00000100:00100000:3.0:1787432376.749646:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609308288 00000100:00100000:3.0:1787432376.749650:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609308288 00000100:00100000:3.0:1787432376.749678:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787432376.749684:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000664e17bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+6:6490:x1874258609308288:12345-0@lo:101: 00010000:00010000:3.0:1787432376.749691:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432376.749699:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001cd8bb94/0xca72b3b33563e6b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e6b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432376.749712:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001cd8bb94/0xca72b3b33563e6b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e6b1 expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432376.749719:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001cd8bb94/0xca72b3b33563e6b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e6b1 expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432376.749911:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001cd8bb94, rc 0) 00000100:00100000:3.0:1787432376.749958:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000664e17bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+7:6490:x1874258609308288:12345-0@lo:101: Request processed in 274us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432376.749964:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787432376.750023:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609308288:0@lo:101: 00010000:00010000:2.0:1787432376.750033:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 00000000823d4c0a/0xca72b3b33563e6b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e6b8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.750041:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 00000000823d4c0a/0xca72b3b33563e6b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e6b8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432376.750051:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787432376.750062:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 00000000823d4c0a/0xca72b3b33563e6b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e6b8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.750069:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: 00000000823d4c0a/0xca72b3b33563e6b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e6b8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432376.750074:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787432376.750078:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787432376.750082:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff948411b1c000 10000000:01000000:2.0:1787432376.750091:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787432376.750094:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787432376.750096:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787432376.750110:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 00000000af29bf76/0xca72b3b33563e6bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.750116:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 00000000af29bf76/0xca72b3b33563e6bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.750121:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 00000000af29bf76/0xca72b3b33563e6bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432376.750132:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609308416:0@lo:101: 00000100:00100000:2.0:1787432376.750157:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432376.750205:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e34817ec going to sleep for 11 seconds 00000100:00100000:2.0:1787432376.750229:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609308416 00000100:00100000:2.0:1787432376.750233:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609308416 00000100:00100000:2.0:1787432376.750256:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432376.750262:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e48153f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+7:6490:x1874258609308416:12345-0@lo:101: 00010000:00010000:2.0:1787432376.750268:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432376.750276:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000048c90c23/0xca72b3b33563e6c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e6bf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.750288:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000048c90c23/0xca72b3b33563e6c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e6bf expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.750295:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000048c90c23/0xca72b3b33563e6c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e6bf expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.750301:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000048c90c23, rc 0) 00000100:00100000:2.0:1787432376.750335:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e48153f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+8:6490:x1874258609308416:12345-0@lo:101: Request processed in 74us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432376.750341:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432376.750370:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609308416:0@lo:101: 00010000:00010000:2.0:1787432376.750379:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 00000000af29bf76/0xca72b3b33563e6bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e6c6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.750386:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 00000000af29bf76/0xca72b3b33563e6bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e6c6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432376.750423:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609308544:0@lo:501: 00000100:00100000:2.0:1787432376.750447:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432376.750459:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e34817ec going to sleep for 11 seconds 00000100:00100000:2.0:1787432376.750472:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609308544 00000100:00100000:2.0:1787432376.750475:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609308544 00000100:00100000:2.0:1787432376.750490:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787432376.750495:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078c3df8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+8:6490:x1874258609308544:12345-0@lo:501: 00000100:00100000:2.0:1787432376.750581:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078c3df8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+9:6490:x1874258609308544:12345-0@lo:501: Request processed in 86us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432376.750588:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787432376.750616:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609308544:0@lo:501: 00000100:00100000:2.0:1787432376.750708:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609308672:0@lo:503: 00000100:00100000:2.0:1787432376.750893:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432376.750979:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e34817ec going to sleep for 11 seconds 00000100:00100000:0.0:1787432376.751525:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609308672 00000100:00100000:0.0:1787432376.751532:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609308672 00000100:00100000:0.0:1787432376.751606:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787432376.751614:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000718ef633 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+9:6490:x1874258609308672:12345-0@lo:503: 00000100:00100000:0.0:1787432376.752448:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000718ef633 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+9:6490:x1874258609308672:12345-0@lo:503: Request processed in 833us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432376.752457:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787432376.752695:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609308672:0@lo:503: 00000100:00100000:2.0:1787432376.753356:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:6535:1874258609308800:0@lo:502: 00000100:00100000:2.0:1787432376.753415:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432376.753478:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e34817ec going to sleep for 11 seconds 00000100:00100000:3.0:1787432376.753523:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609308800 00000100:00100000:3.0:1787432376.753529:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609308800 00000100:00100000:3.0:1787432376.753601:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787432376.753609:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb76d750 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+9:6535:x1874258609308800:12345-0@lo:502: 00000100:00100000:3.0:1787432376.753732:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb76d750 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+9:6535:x1874258609308800:12345-0@lo:502: Request processed in 124us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432376.753740:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787432376.753811:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:6535:1874258609308800:0@lo:502: 00000020:01000000:2.0:1787432376.753836:0:6535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432376.753845:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432376.753848:0:6535:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787432376.753852:0:6535:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787432376.753855:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787432376.753868:0:6535:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000002cea82e1) 00000020:00000080:2.0:1787432376.753886:0:6535:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787432376.753892:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787432376.753983:0:6535:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787432376.753990:0:6535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33563e6d4 00000020:00000080:2.0:1787432376.754246:0:6535:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787432376.754251:0:6535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432376.754255:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432376.754256:0:6535:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787432376.754259:0:6535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432376.754262:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432376.754263:0:6535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787432376.754266:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787432376.754273:0:6535:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000a2a4d9b7) 00000020:00000080:2.0:1787432376.754283:0:6535:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787432376.754286:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787432376.754288:0:6535:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787432376.754291:0:6535:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787432376.754296:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787432376.754344:0:6535:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000da5e5c70 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787432376.754357:0:6535:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000001857d2cd) 00000020:00000080:2.0:1787432376.754365:0:6535:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787432376.754427:0:6535:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787432376.754436:0:6535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b33563e6e9 00000020:00000080:2.0:1787432376.754522:0:6535:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787432376.754527:0:6535:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787432376.754531:0:6535:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xca72b3b33563e6f0 00080000:01000000:2.0:1787432376.754536:0:6535:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787432376.754539:0:6535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33563e6f7 00080000:10000000:2.0:1787432376.754896:0:6535:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1787432376.755043:0:6535:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787432376.760084:0:6535:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787432376.889659:0:6535:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787432376.890407:0:6535:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787432376.893436:0:6535:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787432376.893748:0:6535:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787432376.899129:0:6535:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004d29d187) 00000020:00000080:0.0:1787432376.899159:0:6535:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787432376.899943:0:6535:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787432376.899954:0:6535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33563e705 00000020:00000080:0.0:1787432376.903775:0:6535:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1787432376.906025:0:6535:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1787432376.913852:0:6535:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1787432376.918774:0:6535:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1787432376.922860:0:6535:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1787432376.925086:0:6535:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1787432376.928029:0:6535:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1787432376.934343:0:6535:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xca72b3b33563e70c 00000020:00000080:3.0:1787432376.934955:0:6535:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787432376.934967:0:6535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432376.934974:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432376.934976:0:6535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787432376.934979:0:6535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432376.934983:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432376.934984:0:6535:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787432376.934987:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787432376.934989:0:6535:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787432376.934992:0:6535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432376.934994:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432376.934996:0:6535:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787432376.934998:0:6535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432376.935002:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432376.935004:0:6535:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787432376.935008:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787432376.935051:0:6535:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1787432376.935123:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013a4e476 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:6535:1874258609308928:0@lo:502: 00000100:00100000:3.0:1787432376.935232:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432376.935279:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 0000000057352d7d going to sleep for 11 seconds 00000100:00100000:0.0:1787432376.935349:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609308928 00000100:00100000:0.0:1787432376.935357:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609308928 00000100:00100000:0.0:1787432376.935419:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787432376.935429:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008257f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+9:6535:x1874258609308928:12345-0@lo:502: 00000100:00100000:0.0:1787432376.935787:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008257f3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+9:6535:x1874258609308928:12345-0@lo:502: Request processed in 359us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432376.935806:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787432376.935900:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013a4e476 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:6535:1874258609308928:0@lo:502: 00000020:01000000:3.0:1787432376.935928:0:6535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432376.935948:0:6535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432376.935950:0:6535:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1787432376.935954:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787432376.936117:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787432376.936139:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787432376.936158:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 00000000af29bf76/0xca72b3b33563e6bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e6c6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.936190:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: 00000000af29bf76/0xca72b3b33563e6bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e6c6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432376.936198:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948411b1c000 from 1 10000000:01000000:0.0:1787432376.936201:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787432376.936229:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 000000007c456bbf/0xca72b3b33563e713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.936237:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 000000007c456bbf/0xca72b3b33563e713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.936246:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 000000007c456bbf/0xca72b3b33563e713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432376.936260:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034e4ed18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609309056:0@lo:101: 00000100:00100000:0.0:1787432376.936289:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432376.936307:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 0000000023e2acba going to sleep for 11 seconds 00000100:00100000:0.0:1787432376.936324:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609309056 00000100:00100000:0.0:1787432376.936327:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609309056 00000100:00100000:0.0:1787432376.936349:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787432376.936355:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb806748 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+9:6490:x1874258609309056:12345-0@lo:101: 00010000:00010000:0.0:1787432376.936362:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432376.936373:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a1cb10b0/0xca72b3b33563e71a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e713 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.936583:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a1cb10b0/0xca72b3b33563e71a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e713 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.936592:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a1cb10b0/0xca72b3b33563e71a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e713 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.936599:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a1cb10b0, rc 0) 00000100:00100000:0.0:1787432376.936753:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb806748 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+10:6490:x1874258609309056:12345-0@lo:101: Request processed in 398us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432376.936760:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787432376.936824:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034e4ed18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609309056:0@lo:101: 00010000:00010000:3.0:1787432376.936836:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 000000007c456bbf/0xca72b3b33563e713 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e71a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432376.936845:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 000000007c456bbf/0xca72b3b33563e713 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e71a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432376.937424:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013a4e476 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609309184:0@lo:256: 00000100:00100000:3.0:1787432376.937768:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432376.937803:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 0000000057352d7d going to sleep for 11 seconds 00000100:00100000:0.0:1787432376.937864:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609309184 00000100:00100000:0.0:1787432376.937870:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609309184 00000100:00100000:0.0:1787432376.937909:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787432376.937916:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f18cb064 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+10:6490:x1874258609309184:12345-0@lo:256: 20000000:01000000:0.0:1787432376.937942:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787432376.937948:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787432376.938034:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f18cb064 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+10:6490:x1874258609309184:12345-0@lo:256: Request processed in 119us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432376.938040:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787432376.938125:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013a4e476 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609309184:0@lo:256: 10000000:01000000:1.0:1787432376.938988:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787432376.939010:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 000000007c456bbf/0xca72b3b33563e713 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e71a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.939021:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: 000000007c456bbf/0xca72b3b33563e713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e71a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432376.939029:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948411b1c000 from 1 10000000:01000000:1.0:1787432376.939032:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787432376.939079:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 00000000748c912f/0xca72b3b33563e721 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.939087:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 00000000748c912f/0xca72b3b33563e721 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.939094:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 00000000748c912f/0xca72b3b33563e721 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432376.939111:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009becc8d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609309312:0@lo:101: 00000100:00100000:1.0:1787432376.939152:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432376.939193:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000004cd362f9 going to sleep for 11 seconds 00000100:00100000:0.0:1787432376.939279:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609309312 00000100:00100000:0.0:1787432376.939284:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609309312 00000100:00100000:0.0:1787432376.939321:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787432376.939329:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a74deda2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+10:6490:x1874258609309312:12345-0@lo:101: 00010000:00010000:0.0:1787432376.939338:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432376.939349:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008e45a85b/0xca72b3b33563e728 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e721 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.939391:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008e45a85b/0xca72b3b33563e728 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e721 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.939401:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008e45a85b/0xca72b3b33563e728 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e721 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432376.939409:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008e45a85b, rc 0) 00000100:00100000:0.0:1787432376.939557:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a74deda2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+11:6490:x1874258609309312:12345-0@lo:101: Request processed in 229us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432376.939564:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787432376.939891:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009becc8d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609309312:0@lo:101: 00010000:00010000:1.0:1787432376.939904:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 00000000748c912f/0xca72b3b33563e721 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e728 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.939913:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 00000000748c912f/0xca72b3b33563e721 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e728 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432376.939983:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009becc8d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609309440:0@lo:501: 00000100:00100000:1.0:1787432376.940021:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432376.940050:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000004cd362f9 going to sleep for 11 seconds 00000100:00100000:3.0:1787432376.940126:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609309440 00000100:00100000:3.0:1787432376.940132:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609309440 00000100:00100000:3.0:1787432376.940196:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787432376.940204:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057b63e4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+11:6490:x1874258609309440:12345-0@lo:501: 00000100:00100000:3.0:1787432376.940349:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057b63e4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+11:6490:x1874258609309440:12345-0@lo:501: Request processed in 146us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432376.940356:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787432376.940574:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009becc8d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609309440:0@lo:501: 00000100:00100000:1.0:1787432376.940599:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009becc8d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609309568:0@lo:503: 00000100:00100000:1.0:1787432376.940649:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432376.940670:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000004cd362f9 going to sleep for 11 seconds 00000100:00100000:2.0:1787432376.940770:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609309568 00000100:00100000:2.0:1787432376.940775:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609309568 00000100:00100000:2.0:1787432376.940804:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787432376.940810:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a22ee3c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+11:6490:x1874258609309568:12345-0@lo:503: 00000040:00080000:2.0:1787432376.940839:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787432376.940881:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a22ee3c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+11:6490:x1874258609309568:12345-0@lo:503: Request processed in 71us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432376.940887:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787432376.941075:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009becc8d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609309568:0@lo:503: 00000040:00080000:1.0:1787432376.941976:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787432376.942285:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787432376.942310:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432376.942327:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 00000000748c912f/0xca72b3b33563e721 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e728 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.942337:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: 00000000748c912f/0xca72b3b33563e721 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e728 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432376.942389:0:6490:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787432376.942391:0:6490:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff948411b1c000 10000000:01000000:2.0:1787432376.942394:0:6490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff948411b1c000 10000000:01000000:2.0:1787432376.942398:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787432376.942403:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948411b1c000 from 1 10000000:01000000:2.0:1787432376.942416:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787432376.942460:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 000000001a02ad1e/0xca72b3b33563e72f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.942467:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 000000001a02ad1e/0xca72b3b33563e72f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.942476:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 000000001a02ad1e/0xca72b3b33563e72f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432376.942492:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609309696:0@lo:101: 00000100:00100000:2.0:1787432376.942541:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432376.942575:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000194f74c9 going to sleep for 11 seconds 00000100:00100000:2.0:1787432376.942591:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609309696 00000100:00100000:2.0:1787432376.942597:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609309696 00000100:00100000:2.0:1787432376.942628:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787432376.942648:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057af357b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+11:6490:x1874258609309696:12345-0@lo:101: 00010000:00010000:2.0:1787432376.942659:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432376.942669:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000088fa8b9a/0xca72b3b33563e736 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e72f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.942686:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000088fa8b9a/0xca72b3b33563e736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e72f expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.942695:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000088fa8b9a/0xca72b3b33563e736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e72f expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.942702:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000088fa8b9a, rc 0) 00000100:00100000:2.0:1787432376.942732:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057af357b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:6490:x1874258609309696:12345-0@lo:101: Request processed in 85us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432376.942746:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787432376.942785:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609309696:0@lo:101: 00010000:00010000:2.0:1787432376.942797:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 000000001a02ad1e/0xca72b3b33563e72f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e736 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.942804:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 000000001a02ad1e/0xca72b3b33563e72f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e736 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432376.942850:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609309824:0@lo:501: 00000100:00100000:2.0:1787432376.942875:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432376.942888:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000194f74c9 going to sleep for 11 seconds 00000100:00100000:2.0:1787432376.942900:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609309824 00000100:00100000:2.0:1787432376.942903:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609309824 00000100:00100000:2.0:1787432376.942923:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787432376.942929:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007071a4ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:6490:x1874258609309824:12345-0@lo:501: 00000100:00100000:2.0:1787432376.943039:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007071a4ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:6490:x1874258609309824:12345-0@lo:501: Request processed in 111us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432376.943046:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787432376.943073:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609309824:0@lo:501: 00000100:00100000:2.0:1787432376.943097:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609309952:0@lo:503: 00000100:00100000:2.0:1787432376.943132:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432376.943145:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 00000000194f74c9 going to sleep for 11 seconds 00000100:00100000:2.0:1787432376.943157:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609309952 00000100:00100000:2.0:1787432376.943160:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609309952 00000100:00100000:2.0:1787432376.943207:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787432376.943212:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9793688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:6490:x1874258609309952:12345-0@lo:503: 00000100:00100000:2.0:1787432376.943293:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9793688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:6490:x1874258609309952:12345-0@lo:503: Request processed in 80us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432376.943299:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787432376.943339:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609309952:0@lo:503: 00000100:00100000:2.0:1787432376.943553:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:6540:1874258609310080:0@lo:502: 00000100:00100000:2.0:1787432376.943583:0:6540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432376.943601:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609310080 00000100:00100000:2.0:1787432376.943604:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609310080 00000100:00100000:2.0:1787432376.943626:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787432376.943631:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d55afd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:6540:x1874258609310080:12345-0@lo:502: 00000100:00100000:2.0:1787432376.943698:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d55afd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:6540:x1874258609310080:12345-0@lo:502: Request processed in 66us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432376.943704:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787432376.943733:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032fab61b going to sleep for 11 seconds 00000100:00100000:2.0:1787432376.943744:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:6540:1874258609310080:0@lo:502: 00000020:01000004:2.0:1787432376.943793:0:6540:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787432376.943815:0:6540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b6effa8c) 00000020:00000080:2.0:1787432376.943833:0:6540:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787432376.943924:0:6540:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000da5e5c70 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787432376.943928:0:6540:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000da5e5c70 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787432376.943945:0:6540:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000da5e5c70 4 00010000:00080000:2.0:1787432376.943973:0:6540:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e2962f55@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.124@tcp at head 00010000:00010000:2.0:1787432376.946885:0:6540:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787432376.947206:0:6540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787432376.947262:0:6540:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787432376.947277:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xca72b3b33563e744 00000100:00080000:2.0:1787432376.947287:0:6540:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787432376.947299:0:6540:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e2962f55 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432376.947333:0:6540:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000f553f5e x1874258609310208/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432376.947357:0:6540:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787432376.947443:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874258609310208:0@lo:38: 00000100:00100000:1.0:1787432376.947514:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432376.952272:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609310208 00000100:00100000:3.0:1787432376.952286:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609310208 00000100:00100000:3.0:1787432376.952382:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432376.952391:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009becc8d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874258609310208:12345-0@lo:38: 00000100:00100000:3.0:1787432376.952515:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009becc8d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874258609310208:12345-0@lo:38: Request processed in 124us (5001us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787432376.952523:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787432376.955558:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000047eaf722 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:6540:1874258609310336:0@lo:502: 00000100:00100000:2.0:1787432376.955830:0:6540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432376.955876:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set 00000000357d07a3 going to sleep for 11 seconds 00000100:00100000:1.0:1787432376.956053:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609310336 00000100:00100000:1.0:1787432376.956060:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609310336 00000100:00100000:1.0:1787432376.956105:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787432376.956113:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d59b46b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:6540:x1874258609310336:12345-0@lo:502: 00000100:00100000:1.0:1787432376.956263:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d59b46b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:6540:x1874258609310336:12345-0@lo:502: Request processed in 150us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432376.956271:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787432376.956375:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000047eaf722 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:6540:1874258609310336:0@lo:502: 00000040:00080000:0.0:1787432376.956403:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787432376.956762:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787432376.956785:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787432376.956804:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 000000001a02ad1e/0xca72b3b33563e72f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e736 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432376.956815:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: 000000001a02ad1e/0xca72b3b33563e72f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e736 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787432376.956861:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787432376.956864:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787432376.956865:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432376.956867:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432376.956868:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432376.956869:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432376.956870:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787432376.956872:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787432376.956874:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787432376.956875:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787432376.956876:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432376.956878:0:6490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787432376.956881:0:6490:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787432376.956884:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787432376.956885:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787432376.956886:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432376.956887:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432376.956888:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432376.956894:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432376.956895:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787432376.956896:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787432376.956897:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787432376.956898:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787432376.956898:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432376.956899:0:6490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787432376.956915:0:6490:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787432376.956926:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d5ef3e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609310464:0@lo:253: 00000100:00100000:2.0:1787432376.956971:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432376.957002:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set 000000009d41bf13 going to sleep for 11 seconds 00000100:00100000:0.0:1787432376.957055:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609310464 00000100:00100000:0.0:1787432376.957060:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609310464 00000100:00100000:0.0:1787432376.957100:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787432376.957107:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000184c864e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:6490:x1874258609310464:12345-0@lo:253: 20000000:01000000:0.0:1787432376.957127:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787432376.957141:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787432376.957980:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787432376.957990:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000e2962f55 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787432376.957995:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787432376.957998:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f553f5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874258609310208:0@lo:38: 20000000:01000000:0.0:1787432376.963383:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787432376.963440:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787432376.963865:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000184c864e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:6490:x1874258609310464:12345-0@lo:253: Request processed in 6755us (6890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432376.963879:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787432376.964004:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d5ef3e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:6490:1874258609310464:0@lo:253: 10000000:01000000:2.0:1787432376.964019:0:6490:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787432376.964023:0:6490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787432376.964025:0:6490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787432376.964026:0:6490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432376.964027:0:6490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432376.964028:0:6490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432376.964029:0:6490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432376.964030:0:6490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787432376.964032:0:6490:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787432376.964033:0:6490:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787432376.964034:0:6490:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787432376.964036:0:6490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432376.964037:0:6490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787432376.964051:0:6490:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1787432376.970528:0:6529:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787432376.970539:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787432376.970588:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000269d4848/0xca72b3b33563e74b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.970610:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a1cb10b0/0xca72b3b33563e71a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e713 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.970618:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000269d4848/0xca72b3b33563e74b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.971243:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a1cb10b0/0xca72b3b33563e71a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e713 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.971260:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a1cb10b0/0xca72b3b33563e71a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e713 expref: 11 pid: 6508 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432376.971274:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001818bfd4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1874258609310592:0@lo:104: 00000100:00100000:1.0:1787432376.971337:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432376.971444:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set 000000004cd362f9 going to sleep for 11 seconds 00080000:10000000:2.0:1787432376.973148:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1787432376.973611:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787432376.973871:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1787432376.974019:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787432376.974211:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1787432376.974346:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:3.0:1787432376.974886:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609310592 00000100:00100000:3.0:1787432376.974900:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609310592 00000100:00100000:3.0:1787432376.974956:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432376.974966:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005831393f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6529:x1874258609310592:12345-0@lo:104: 00010000:00010000:3.0:1787432376.974984:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: 000000007c456bbf/0xca72b3b33563e713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e71a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432376.975074:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787432376.975080:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005831393f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6529:x1874258609310592:12345-0@lo:104: Request processed in 116us (3744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432376.975088:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432376.975147:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001818bfd4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1874258609310592:0@lo:104: 00010000:00010000:3.0:1787432376.975200:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000269d4848/0xca72b3b33563e74b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.975580:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432376.975585:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: 000000007c456bbf/0xca72b3b33563e713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e71a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.975593:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007c456bbf already unused, calling callback (000000002e80036b) 10000000:00010000:1.0:1787432376.975596:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: 000000007c456bbf/0xca72b3b33563e713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e71a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.975604:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: 000000007c456bbf/0xca72b3b33563e713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e71a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432376.975610:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: 000000007c456bbf/0xca72b3b33563e713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e71a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432376.975615:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432376.975815:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: 000000007c456bbf/0xca72b3b33563e713 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e71a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.975823:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432376.975856:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: 000000007c456bbf/0xca72b3b33563e713 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e71a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.975873:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: 000000007c456bbf/0xca72b3b33563e713 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e71a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.975891:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432376.975892:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432376.975894:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432376.976004:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000098980626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609310720:0@lo:103: 00000100:00100000:3.0:1787432376.976061:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432376.976212:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609310720 00000100:00100000:1.0:1787432376.976219:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609310720 00010000:00010000:1.0:1787432376.976241:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a1cb10b0/0xca72b3b33563e71a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e713 expref: 12 pid: 6508 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432376.976266:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432376.976273:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b79967d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:3642:x1874258609310720:12345-0@lo:103: 00010000:00010000:1.0:1787432376.976284:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432376.976288:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a1cb10b0/0xca72b3b33563e71a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e713 expref: 12 pid: 6508 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.976298:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a1cb10b0/0xca72b3b33563e71a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e713 expref: 12 pid: 6508 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.976311:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a1cb10b0/0xca72b3b33563e71a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e713 expref: 12 pid: 6508 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.976324:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000269d4848/0xca72b3b33563e74b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.976331:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000269d4848/0xca72b3b33563e74b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787432376.976357:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005818009s 00010000:00010000:1.0:1787432376.976360:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000269d4848/0xca72b3b33563e74b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.976367:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000269d4848/0xca72b3b33563e74b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.976372:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000269d4848/0xca72b3b33563e74b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.976379:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000269d4848/0xca72b3b33563e74b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.976384:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000269d4848 already unused, calling callback (0000000033074501) 00010000:00010000:1.0:1787432376.976388:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000269d4848/0xca72b3b33563e74b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.976394:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000269d4848/0xca72b3b33563e74b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.976405:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000269d4848/0xca72b3b33563e74b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432376.976413:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432376.976548:0:6529:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000269d4848/0xca72b3b33563e74b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432376.976555:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000269d4848/0xca72b3b33563e74b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432376.976561:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000269d4848/0xca72b3b33563e74b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432376.976974:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b79967d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+11:3642:x1874258609310720:12345-0@lo:103: Request processed in 699us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432376.976983:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:0.0:1787432376.977952:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1787432376.978132:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00000100:00100000:3.0:1787432376.978326:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000098980626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609310720:0@lo:103: 00080000:10000000:0.0:1787432376.978793:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1787432376.978971:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1787432376.979820:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1787432376.980027:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1787432376.985620:0:6490:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1787432377.000978:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787432377.001305:0:6546:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787432377.002679:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787432377.002780:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787432377.003253:0:6490:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787432377.003261:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787432377.003395:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432377.004391:0:6490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:3.0:1787432377.008255:0:6545:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787432377.008266:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:0.0:1787432377.009491:0:6546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432377.014278:0:6490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787432377.014335:0:6490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787432377.014615:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787432377.014852:0:6490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1787432377.015586:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787432377.015717:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787432377.015877:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787432377.016033:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787432377.016226:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787432377.016363:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00000040:00080000:0.0:1787432377.018360:0:6546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787432377.018497:0:6546:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787432377.018502:0:6546:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1787432377.022084:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787432377.023018:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787432377.026874:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787432377.028922:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787432377.029150:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787432377.030950:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787432377.031124:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787432377.032584:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787432377.033424:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787432377.033821:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787432377.034124:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787432377.035795:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787432377.035970:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787432377.036152:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787432377.037809:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787432377.037984:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787432377.038131:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787432377.039599:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787432377.040586:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787432377.040899:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787432377.041050:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787432377.042554:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787432377.043360:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787432377.044598:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787432377.044963:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787432377.045111:0:6490:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787432377.045829:0:6490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1787432377.051109:0:6490:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787432377.051149:0:6490:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb0c1c1c8b988 00100000:10000000:3.0:1787432377.051158:0:6490:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787432377.052073:0:6490:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787432377.052089:0:6490:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.124@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787432377.052106:0:6490:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787432377.052123:0:6490:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1787432377.054480:0:6490:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432377.055086:0:6490:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1787432377.547302:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432378.571416:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432379.596329:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432380.619486:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432381.647797:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787432382.059616:0:6791:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1787432382.411249:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787432382.411258:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948411b1c000 from 3 10000000:01000000:2.0:1787432382.411263:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787432382.411379:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 00000000af3438a4/0xca72b3b33563e752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432382.411392:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 00000000af3438a4/0xca72b3b33563e752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432382.411419:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 00000000af3438a4/0xca72b3b33563e752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432382.411442:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d5ef3e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609310848:0@lo:101: 00000100:00100000:2.0:1787432382.412104:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432382.412158:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a55ccb5c going to sleep for 11 seconds 00000100:00100000:2.0:1787432382.412209:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609310848 00000100:00100000:2.0:1787432382.412216:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609310848 00000100:00100000:2.0:1787432382.412262:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787432382.412271:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001512b48b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+11:6511:x1874258609310848:12345-0@lo:101: 00010000:00010000:2.0:1787432382.412284:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432382.412597:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001539c1e5/0xca72b3b33563e759 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e752 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432382.412623:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001539c1e5/0xca72b3b33563e759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e752 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432382.412633:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001539c1e5/0xca72b3b33563e759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e752 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432382.412641:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001539c1e5, rc 0) 00000100:00100000:1.0:1787432382.412687:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000135c92c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609310976:0@lo:400: 00000100:00100000:2.0:1787432382.412688:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001512b48b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:6511:x1874258609310848:12345-0@lo:101: Request processed in 417us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432382.412695:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787432382.412740:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432382.412752:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d5ef3e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609310848:0@lo:101: 00010000:00010000:2.0:1787432382.412769:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 00000000af3438a4/0xca72b3b33563e752 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e759 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432382.412787:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 00000000af3438a4/0xca72b3b33563e752 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e759 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432382.413454:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d5ef3e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609311104:0@lo:256: 00000100:00100000:2.0:1787432382.413488:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432382.413626:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a55ccb5c going to sleep for 11 seconds 00000100:00100000:2.0:1787432382.413646:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609310976 00000100:00100000:2.0:1787432382.413651:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609310976 00000100:00100000:2.0:1787432382.413677:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609311104 00000100:00100000:2.0:1787432382.413679:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609311104 00000100:00100000:2.0:1787432382.413691:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787432382.413696:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000563d353 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+13:3643:x1874258609310976:12345-0@lo:400: 00000100:00080000:0.0:1787432382.414071:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787432382.414077:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787432382.414080:0:36:0:(import.c:65:import_set_state_nolock()) 00000000e2962f55 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432382.414088:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e2962f55 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432382.414111:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d13633ab x1874258609311232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432382.416719:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787432382.416742:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004c53a73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+13:6511:x1874258609311104:12345-0@lo:256: 20000000:01000000:3.0:1787432382.416771:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787432382.416793:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787432382.416797:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787432382.416997:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000135c92c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609310976:0@lo:400: 00000100:00100000:3.0:1787432382.417541:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004c53a73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+13:6511:x1874258609311104:12345-0@lo:256: Request processed in 809us (4052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432382.417552:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787432382.417618:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d5ef3e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609311104:0@lo:256: 10000000:01000000:0.0:1787432382.417669:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787432382.417679:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 00000000af3438a4/0xca72b3b33563e752 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e759 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432382.417690:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: 00000000af3438a4/0xca72b3b33563e752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e759 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432382.418629:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000563d353 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:3643:x1874258609310976:12345-0@lo:400: Request processed in 4929us (5887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432382.418641:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787432382.418687:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d13633ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874258609311232:0@lo:38: 00000100:00100000:2.0:1787432382.418727:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432382.418902:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609311232 00000100:00100000:0.0:1787432382.418910:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609311232 00000100:00100000:0.0:1787432382.419064:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432382.419071:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f553f5e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874258609311232:12345-0@lo:38: 00010000:00080000:0.0:1787432382.419104:0:6515:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:0.0:1787432382.419135:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xca72b3b33563e760 00000004:00100000:0.0:1787432382.419195:0:6515:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787432382.419446:0:6515:0:(import.c:65:import_set_state_nolock()) 0000000012b0f02e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432382.419574:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f553f5e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874258609311232:12345-0@lo:38: Request processed in 436us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432382.419582:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787432382.419657:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d13633ab x1874258609311232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787432382.419672:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787432382.419679:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787432382.419684:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787432382.419686:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000e2962f55 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787432382.419691:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d13633ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874258609311232:0@lo:38: 00010000:00010000:0.0:1787432382.668737:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787432382.997128:0:6843:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787432382.997470:0:6843:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787432383.693458:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432384.716907:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787432385.701662:0:6944:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432385.702056:0:6944:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787432385.740447:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432386.763469:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432387.532455:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432387.532480:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033b466ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609311360:0@lo:400: 00000100:00100000:0.0:1787432387.532553:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432387.532603:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f096581f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609311488:0@lo:400: 00000100:00100000:0.0:1787432387.532633:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432387.532665:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609311360 00000100:00100000:0.0:1787432387.532672:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609311360 00000100:00100000:0.0:1787432387.532712:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787432387.532720:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000848072ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:3643:x1874258609311360:12345-0@lo:400: 00000100:00100000:0.0:1787432387.532803:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000848072ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:3643:x1874258609311360:12345-0@lo:400: Request processed in 85us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432387.532810:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787432387.532854:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033b466ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609311360:0@lo:400: 00000100:00100000:3.0:1787432387.534603:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609311488 00000100:00100000:3.0:1787432387.534618:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609311488 00000100:00100000:3.0:1787432387.534681:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432387.534690:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad5da63a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609311488:12345-0@lo:400: 00000100:00100000:3.0:1787432387.534863:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad5da63a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609311488:12345-0@lo:400: Request processed in 175us (2230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432387.534870:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787432387.535524:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f096581f x1874258609311488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432387.535538:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f096581f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609311488:0@lo:400: 00010000:00010000:2.0:1787432387.789313:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432388.816860:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432389.841501:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432390.862451:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432391.888223:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432392.665776:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432392.665799:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000088e0a0ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609311744:0@lo:400: 00000100:00100000:1.0:1787432392.665945:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432392.666161:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e09ec2f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609311616:0@lo:400: 00000100:00100000:0.0:1787432392.666227:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432392.666296:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609311744 00000100:00100000:0.0:1787432392.666304:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609311744 00000100:00100000:1.0:1787432392.666677:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609311616 00000100:00100000:1.0:1787432392.666683:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609311616 00000100:00100000:1.0:1787432392.666724:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787432392.666732:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005343f00b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:3642:x1874258609311616:12345-0@lo:400: 00000100:00100000:1.0:1787432392.666784:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005343f00b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:3642:x1874258609311616:12345-0@lo:400: Request processed in 53us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432392.666790:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787432392.666977:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432392.666985:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2a2e88f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609311744:12345-0@lo:400: 00000100:00100000:0.0:1787432392.667024:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2a2e88f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609311744:12345-0@lo:400: Request processed in 41us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432392.667030:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432392.667068:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e09ec2f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609311616:0@lo:400: 00010000:00080000:0.0:1787432392.667101:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000088e0a0ea x1874258609311744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432392.667114:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000088e0a0ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609311744:0@lo:400: 00010000:00010000:0.0:1787432392.907503:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432393.938544:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432394.955673:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432395.982209:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787432396.413135:0:7443:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787432396.413140:0:7443:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787432396.413142:0:7443:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787432396.413440:0:7443:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000003e771501 00000020:01000004:1.0:1787432396.413457:0:7443:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1787432396.414159:0:7443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787432396.415560:0:7443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000061cf7ab2) 00000020:00000080:1.0:1787432396.415593:0:7443:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787432396.495355:0:7443:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1787432396.495432:0:7443:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1787432396.507417:0:7443:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787432396.507664:0:7443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787432396.507677:0:7443:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787432396.507688:0:7443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xca72b3b33563e76e 00000020:01000004:1.0:1787432396.507695:0:7443:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787432396.507722:0:7443:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.124@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787432396.507725:0:7443:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787432396.507731:0:7443:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787432396.507758:0:7443:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787432396.507762:0:7443:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.124@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1787432396.520458:0:7443:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.124@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787432396.520500:0:7443:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.124@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1787432396.520504:0:7443:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787432396.520506:0:7443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787432396.520507:0:7443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432396.520508:0:7443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432396.520509:0:7443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432396.520510:0:7443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432396.520511:0:7443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787432396.520512:0:7443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787432396.520514:0:7443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787432396.520515:0:7443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432396.520517:0:7443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787432396.520520:0:7443:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1787432396.520523:0:7443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787432396.520524:0:7443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787432396.520525:0:7443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432396.520526:0:7443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432396.520527:0:7443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432396.520528:0:7443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432396.520529:0:7443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787432396.520529:0:7443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787432396.520530:0:7443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787432396.520531:0:7443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432396.520532:0:7443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787432396.520571:0:7443:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787432396.520588:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002512e249 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609311872:0@lo:253: 00000100:00100000:1.0:1787432396.520661:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432396.520709:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000869c0206 going to sleep for 11 seconds 00000100:00100000:3.0:1787432396.522026:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609311872 00000100:00100000:3.0:1787432396.522036:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609311872 00000100:00100000:3.0:1787432396.522093:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432396.522102:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a816355d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:7443:x1874258609311872:12345-0@lo:253: 20000000:01000000:3.0:1787432396.522132:0:6508:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787432396.522136:0:6508:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1787432396.522140:0:6508:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1787432396.522144:0:6508:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1787432396.522274:0:6508:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1787432396.522485:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787432396.522625:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1787432396.522638:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787432396.522654:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1787432396.522668:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1787432396.522680:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1787432396.522743:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1787432396.522751:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1787432396.522762:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1787432396.522767:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1787432396.522778:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1787432396.522782:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1787432396.522793:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1787432396.522804:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1787432396.522914:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1787432396.522935:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.124@tcp (null) (null) (null) 00000040:00080000:3.0:1787432396.522948:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1787432396.522955:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787432396.522965:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1787432396.522969:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.124@tcp (null) (null) 00000040:00080000:3.0:1787432396.522979:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1787432396.522983:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787432396.522995:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1787432396.523009:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1787432396.523019:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1787432396.523093:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1787432396.523102:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1787432396.523117:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1787432396.523133:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1787432396.523150:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1787432396.523157:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1787432396.523391:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1787432396.523417:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1787432396.523423:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1787432396.523444:0:6508:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787432396.523451:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1787432396.523990:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1787432396.524268:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787432396.524288:0:6508:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.124@tcp for mdt 20000000:01000000:3.0:1787432396.524290:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.124@tcp (null) (null) (null) 00000040:00080000:3.0:1787432396.524305:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787432396.524311:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787432396.524321:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787432396.524326:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.124@tcp (null) (null) 00000040:00080000:3.0:1787432396.524340:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787432396.524361:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1787432396.524377:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1787432396.524393:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1787432396.524438:0:6508:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1787432396.524446:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1787432396.524902:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1787432396.525128:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787432396.525145:0:6508:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.204.124@tcp for mdt 20000000:01000000:3.0:1787432396.525146:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.124@tcp (null) (null) (null) 00000040:00080000:3.0:1787432396.525196:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1787432396.525204:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787432396.525220:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787432396.525225:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.124@tcp (null) (null) 00000040:00080000:3.0:1787432396.525238:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787432396.525256:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1787432396.525270:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787432396.525284:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1787432396.525302:0:6508:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787432396.525305:0:6508:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787432396.525309:0:6508:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787432396.525371:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787432396.525374:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787432396.526036:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787432396.526068:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787432396.526081:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1787432396.526336:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1787432396.526358:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1787432396.526376:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1787432396.526387:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787432396.526389:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787432396.527476:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1787432396.527512:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1787432396.527527:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787432396.527781:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787432396.527805:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787432396.527829:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787432396.527842:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787432396.527844:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787432396.528495:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787432396.528519:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787432396.528557:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787432396.528771:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1787432396.528795:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1787432396.528812:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1787432396.528825:0:6508:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787432396.528828:0:6508:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787432396.528833:0:6508:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787432396.528840:0:6508:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787432396.529442:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1787432396.529543:0:6508:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787432396.543462:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787432396.543607:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009df618c8/0xca72b3b33563e775 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.543628:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000eda33c0a/0xca72b3b33563e6aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e6a3 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.543635:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000048c90c23/0xca72b3b33563e6c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e6bf expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.543654:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000088fa8b9a/0xca72b3b33563e736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e72f expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.543661:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009df618c8/0xca72b3b33563e775 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.543701:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000088fa8b9a/0xca72b3b33563e736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e72f expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.543716:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000088fa8b9a/0xca72b3b33563e736 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e72f expref: 12 pid: 6508 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432396.543730:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c8d0704 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609312000:0@lo:104: 00000100:00100000:2.0:1787432396.543792:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432396.543841:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000048c90c23/0xca72b3b33563e6c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e6bf expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.543849:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000048c90c23/0xca72b3b33563e6c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e6bf expref: 12 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432396.543856:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd6b1829 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609312128:0@lo:104: 00000100:00100000:2.0:1787432396.543875:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432396.543907:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609312000 00000100:00100000:2.0:1787432396.543914:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609312000 00000100:00100000:3.0:1787432396.544048:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609312128 00000100:00100000:3.0:1787432396.544053:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609312128 00000100:00100000:2.0:1787432396.544110:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787432396.547642:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000eda33c0a/0xca72b3b33563e6aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e6a3 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432396.547663:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000eda33c0a/0xca72b3b33563e6aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e6a3 expref: 12 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432396.547679:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009333579e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609312256:0@lo:104: 00000100:00100000:3.0:1787432396.547756:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432396.547799:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e0bac642 going to sleep for 11 seconds 00000100:00100000:0.0:1787432396.547857:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1787432396.547866:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1787432396.548561:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609312256 00000100:00100000:3.0:1787432396.548570:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609312256 00000100:00100000:0.0:1787432396.548702:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432396.548711:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ddd65b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+5:6508:x1874258609312128:12345-0@lo:104: 00010000:00010000:0.0:1787432396.548735:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: 00000000af29bf76/0xca72b3b33563e6bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e6c6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.548818:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787432396.548824:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ddd65b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+5:6508:x1874258609312128:12345-0@lo:104: Request processed in 114us (4948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.548831:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787432396.548850:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432396.548855:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: 00000000af29bf76/0xca72b3b33563e6bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e6c6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.548862:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000af29bf76 already unused, calling callback (000000002e80036b) 10000000:00010000:0.0:1787432396.548865:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: 00000000af29bf76/0xca72b3b33563e6bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e6c6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.548872:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: 00000000af29bf76/0xca72b3b33563e6bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e6c6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432396.548879:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: 00000000af29bf76/0xca72b3b33563e6bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e6c6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432396.548885:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432396.548918:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: 00000000af29bf76/0xca72b3b33563e6bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e6c6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.548938:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432396.548953:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: 00000000af29bf76/0xca72b3b33563e6bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e6c6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.548959:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: 00000000af29bf76/0xca72b3b33563e6bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e6c6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.548979:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432396.548980:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432396.548982:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432396.549006:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f096581f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609312384:0@lo:103: 00000100:00100000:0.0:1787432396.549038:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432396.549087:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609312384 00000100:00100000:0.0:1787432396.549091:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609312384 00010000:00010000:0.0:1787432396.549107:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000048c90c23/0xca72b3b33563e6c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e6bf expref: 13 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432396.549128:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432396.549134:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033b466ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+13:3644:x1874258609312384:12345-0@lo:103: 00010000:00010000:0.0:1787432396.549144:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432396.549148:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000048c90c23/0xca72b3b33563e6c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e6bf expref: 13 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.549156:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000048c90c23/0xca72b3b33563e6c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e6bf expref: 13 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.549194:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432396.549221:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033b466ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+13:3644:x1874258609312384:12345-0@lo:103: Request processed in 87us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.549227:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432396.549275:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f096581f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609312384:0@lo:103: 00000100:00100000:0.0:1787432396.549299:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432396.549305:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086acdcd4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6508:x1874258609312256:12345-0@lo:104: 00010000:00010000:0.0:1787432396.549319:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e6a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e6aa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.549359:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787432396.549363:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086acdcd4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6508:x1874258609312256:12345-0@lo:104: Request processed in 60us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.549369:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787432396.549383:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432396.549387:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e6a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e6aa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.549393:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cc1a3282 already unused, calling callback (000000002e80036b) 10000000:00010000:0.0:1787432396.549395:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e6a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e6aa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.549400:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e6aa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432396.549405:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e6aa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432396.549411:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432396.549428:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e6a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e6aa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.549434:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432396.549445:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e6a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e6aa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.549450:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e6a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e6aa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.549466:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432396.549467:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432396.549469:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432396.549482:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f096581f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609312512:0@lo:103: 00000100:00100000:0.0:1787432396.549505:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432396.549537:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609312512 00000100:00100000:0.0:1787432396.549541:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609312512 00010000:00010000:0.0:1787432396.549567:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000eda33c0a/0xca72b3b33563e6aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e6a3 expref: 13 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432396.549586:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432396.549592:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063bb9fd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+13:3641:x1874258609312512:12345-0@lo:103: 00010000:00010000:0.0:1787432396.549599:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432396.549602:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000eda33c0a/0xca72b3b33563e6aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e6a3 expref: 13 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.549609:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000eda33c0a/0xca72b3b33563e6aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e6a3 expref: 13 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.549618:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432396.549643:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063bb9fd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+13:3641:x1874258609312512:12345-0@lo:103: Request processed in 52us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.549649:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432396.549672:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f096581f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609312512:0@lo:103: 00010000:00010000:3.0:1787432396.550273:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000048c90c23/0xca72b3b33563e6c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e6bf expref: 12 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432396.550288:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd6b1829 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609312128:0@lo:104: 00010000:00010000:3.0:1787432396.550299:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eda33c0a/0xca72b3b33563e6aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e6a3 expref: 11 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432396.550308:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009333579e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609312256:0@lo:104: 00000100:00100000:2.0:1787432396.553410:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eaebf137 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6508:x1874258609312000:12345-0@lo:104: 00010000:00010000:2.0:1787432396.553435:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: 000000001a02ad1e/0xca72b3b33563e72f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e736 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.553626:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787432396.553633:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eaebf137 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6508:x1874258609312000:12345-0@lo:104: Request processed in 9515us (9841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432396.553643:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787432396.555733:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432396.555742:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: 000000001a02ad1e/0xca72b3b33563e72f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e736 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.555774:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001a02ad1e already unused, calling callback (000000002e80036b) 10000000:00010000:0.0:1787432396.555778:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: 000000001a02ad1e/0xca72b3b33563e72f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e736 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.555787:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: 000000001a02ad1e/0xca72b3b33563e72f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e736 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432396.555793:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: 000000001a02ad1e/0xca72b3b33563e72f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e736 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432396.555799:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432396.555843:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: 000000001a02ad1e/0xca72b3b33563e72f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e736 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.555850:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432396.555866:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: 000000001a02ad1e/0xca72b3b33563e72f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e736 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.555872:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: 000000001a02ad1e/0xca72b3b33563e72f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e736 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.555888:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432396.555889:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432396.555891:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432396.555909:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f096581f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609312640:0@lo:103: 00000100:00100000:0.0:1787432396.556193:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432396.556345:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609312640 00000100:00100000:1.0:1787432396.556352:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609312640 00010000:00010000:1.0:1787432396.556378:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000088fa8b9a/0xca72b3b33563e736 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e72f expref: 11 pid: 6508 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432396.556414:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787432396.556422:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000997c37b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+11:3642:x1874258609312640:12345-0@lo:103: 00010000:00010000:1.0:1787432396.556434:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432396.556439:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000088fa8b9a/0xca72b3b33563e736 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e72f expref: 11 pid: 6508 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.556449:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000088fa8b9a/0xca72b3b33563e736 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e72f expref: 11 pid: 6508 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.556480:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009df618c8/0xca72b3b33563e775 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.556488:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009df618c8/0xca72b3b33563e775 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.556503:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009df618c8/0xca72b3b33563e775 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.556510:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009df618c8/0xca72b3b33563e775 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.556516:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009df618c8/0xca72b3b33563e775 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.556522:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009df618c8/0xca72b3b33563e775 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.556527:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009df618c8 already unused, calling callback (0000000033074501) 00010000:00010000:1.0:1787432396.556530:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009df618c8/0xca72b3b33563e775 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.556536:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009df618c8/0xca72b3b33563e775 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.556543:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009df618c8/0xca72b3b33563e775 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.556565:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432396.556595:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000997c37b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+11:3642:x1874258609312640:12345-0@lo:103: Request processed in 174us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432396.556610:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432396.556744:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f096581f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609312640:0@lo:103: 00010000:00010000:3.0:1787432396.558431:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000088fa8b9a/0xca72b3b33563e736 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e72f expref: 10 pid: 6508 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432396.558448:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c8d0704 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609312000:0@lo:104: 00010000:00010000:3.0:1787432396.558473:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009df618c8/0xca72b3b33563e775 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.561331:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009df618c8/0xca72b3b33563e775 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.561352:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009df618c8/0xca72b3b33563e775 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.561359:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009df618c8/0xca72b3b33563e775 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787432396.561382:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787432396.565722:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a816355d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+9:7443:x1874258609311872:12345-0@lo:253: Request processed in 43613us (45054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432396.565739:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787432396.565849:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002512e249 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609311872:0@lo:253: 10000000:01000000:1.0:1787432396.565865:0:7443:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787432396.565868:0:7443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787432396.565870:0:7443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787432396.565871:0:7443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432396.565873:0:7443:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1787432396.565874:0:7443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432396.565875:0:7443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432396.565877:0:7443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787432396.565879:0:7443:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787432396.565880:0:7443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432396.565882:0:7443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787432396.565903:0:7443:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003e771501 from lustre-MDT0001 10000000:01000000:1.0:1787432396.565945:0:7443:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1787432396.565948:0:7443:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787432396.565954:0:7443:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9484336199b8 local copy 10000000:01000000:1.0:1787432396.565958:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787432396.565996:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e77c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.566007:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e77c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.566016:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e77c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432396.566037:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002512e249 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609312768:0@lo:101: 00000100:00100000:1.0:1787432396.566073:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432396.566148:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 0000000048e99acf going to sleep for 11 seconds 00000100:00100000:0.0:1787432396.568883:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609312768 00000100:00100000:0.0:1787432396.568912:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609312768 00000100:00100000:0.0:1787432396.569093:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787432396.569103:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049de158b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+9:7443:x1874258609312768:12345-0@lo:101: 00010000:00010000:0.0:1787432396.569120:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432396.569137:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000087c3ac6/0xca72b3b33563e783 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e77c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.569191:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000087c3ac6/0xca72b3b33563e783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e77c expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.569203:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000087c3ac6/0xca72b3b33563e783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e77c expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.569211:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000087c3ac6, rc 0) 00000100:00100000:0.0:1787432396.569304:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049de158b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+10:7443:x1874258609312768:12345-0@lo:101: Request processed in 202us (3231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.569311:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787432396.569413:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002512e249 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609312768:0@lo:101: 00010000:00010000:2.0:1787432396.569431:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e77c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xca72b3b33563e783 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.569440:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e77c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xca72b3b33563e783 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432396.569561:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f79a0fee pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609312896:0@lo:501: 00000100:00100000:2.0:1787432396.569595:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432396.570535:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 0000000077d62a72 going to sleep for 11 seconds 00000100:00100000:1.0:1787432396.570635:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609312896 00000100:00100000:1.0:1787432396.570658:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609312896 00000100:00100000:1.0:1787432396.570696:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787432396.570703:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000525d9f08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+10:7443:x1874258609312896:12345-0@lo:501: 00000100:00100000:1.0:1787432396.571643:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000525d9f08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+10:7443:x1874258609312896:12345-0@lo:501: Request processed in 938us (2045us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787432396.571653:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787432396.571772:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f79a0fee pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609312896:0@lo:501: 10000000:01000000:2.0:1787432396.571806:0:7443:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787432396.571833:0:7443:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787432396.571839:0:7443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e77c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xca72b3b33563e783 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.571849:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e77c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xca72b3b33563e783 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.571855:0:7443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e77c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xca72b3b33563e783 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.571881:0:7443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787432396.571906:0:7443:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94842dfc5000 10000000:01000000:2.0:1787432396.571911:0:7443:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787432396.571916:0:7443:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9484336199b8 10000000:01000000:2.0:1787432396.571928:0:7443:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787432396.571932:0:7443:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9484336199b8 from 1 10000000:01000000:2.0:1787432396.571935:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787432396.571963:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 00000000d648045a/0xca72b3b33563e78a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.571970:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 00000000d648045a/0xca72b3b33563e78a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.571979:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 00000000d648045a/0xca72b3b33563e78a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432396.571995:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f79a0fee pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609313024:0@lo:101: 00000100:00100000:2.0:1787432396.572027:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432396.572056:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000007309ebef going to sleep for 11 seconds 00010000:00010000:1.0:1787432396.572187:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432396.572192:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e77c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xca72b3b33563e783 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.572200:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009f90788d already unused, calling callback (000000002e80036b) 10000000:00010000:1.0:1787432396.572203:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e77c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xca72b3b33563e783 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.572210:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e77c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xca72b3b33563e783 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432396.572215:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e77c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xca72b3b33563e783 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432396.572221:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432396.572250:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e77c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xca72b3b33563e783 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.572257:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432396.572276:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e77c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xca72b3b33563e783 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.572282:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e77c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xca72b3b33563e783 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.572307:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432396.572309:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432396.572310:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432396.572317:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432396.572327:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd0587bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609313152:0@lo:103: 00000100:00100000:1.0:1787432396.572354:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432396.572380:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609313152 00000100:00100000:1.0:1787432396.572384:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609313152 00000100:00100000:1.0:1787432396.572420:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432396.572428:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eeef7060 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+10:3644:x1874258609313152:12345-0@lo:103: 00010000:00010000:1.0:1787432396.572437:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432396.572451:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000087c3ac6/0xca72b3b33563e783 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563e77c expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.572467:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432396.572495:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eeef7060 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+9:3644:x1874258609313152:12345-0@lo:103: Request processed in 69us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432396.572501:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432396.572524:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd0587bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609313152:0@lo:103: 00000100:00100000:1.0:1787432396.572544:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609313024 00000100:00100000:1.0:1787432396.572558:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609313024 00000100:00100000:1.0:1787432396.572575:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787432396.572580:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f1164c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+9:7443:x1874258609313024:12345-0@lo:101: 00010000:00010000:1.0:1787432396.572590:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432396.572599:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000269d4848/0xca72b3b33563e791 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e78a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.572625:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000269d4848/0xca72b3b33563e791 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e78a expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.572634:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000269d4848/0xca72b3b33563e791 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e78a expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.572640:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000269d4848, rc 0) 00000100:00100000:1.0:1787432396.572663:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f1164c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+10:7443:x1874258609313024:12345-0@lo:101: Request processed in 83us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432396.572668:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787432396.574436:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f79a0fee pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609313024:0@lo:101: 00010000:00010000:2.0:1787432396.574462:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 00000000d648045a/0xca72b3b33563e78a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e791 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.574474:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 00000000d648045a/0xca72b3b33563e78a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e791 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432396.574497:0:7443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787432396.574506:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 00000000d648045a/0xca72b3b33563e78a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e791 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.574512:0:7443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: 00000000d648045a/0xca72b3b33563e78a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e791 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432396.574523:0:7443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff94842dfc5000 10000000:01000000:2.0:1787432396.574531:0:7443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787432396.574537:0:7443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff94842dfc5000 from 1 10000000:01000000:2.0:1787432396.574539:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787432396.574580:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 000000009df618c8/0xca72b3b33563e798 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.574588:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 000000009df618c8/0xca72b3b33563e798 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.574596:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 000000009df618c8/0xca72b3b33563e798 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432396.574612:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f79a0fee pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609313280:0@lo:101: 00000100:00100000:2.0:1787432396.574663:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432396.574708:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000007309ebef going to sleep for 11 seconds 00000100:00100000:1.0:1787432396.574768:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609313280 00000100:00100000:1.0:1787432396.574775:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609313280 00000100:00100000:1.0:1787432396.574828:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787432396.574837:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d16567f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+10:7443:x1874258609313280:12345-0@lo:101: 00010000:00010000:1.0:1787432396.574850:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432396.574861:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fab01814/0xca72b3b33563e79f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e798 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.574879:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fab01814/0xca72b3b33563e79f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e798 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.574888:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fab01814/0xca72b3b33563e79f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e798 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.574896:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fab01814, rc 0) 00000100:00100000:1.0:1787432396.574942:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d16567f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+11:7443:x1874258609313280:12345-0@lo:101: Request processed in 106us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432396.574948:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787432396.575100:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f79a0fee pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609313280:0@lo:101: 00010000:00010000:2.0:1787432396.575111:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 000000009df618c8/0xca72b3b33563e798 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e79f expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.575118:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 000000009df618c8/0xca72b3b33563e798 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e79f expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432396.575129:0:7443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787432396.575131:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 000000009df618c8/0xca72b3b33563e798 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e79f expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.575137:0:7443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: 000000009df618c8/0xca72b3b33563e798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e79f expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432396.575143:0:7443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787432396.575146:0:7443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787432396.575151:0:7443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff94842dfc5000 10000000:01000000:2.0:1787432396.575154:0:7443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787432396.575156:0:7443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787432396.575158:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787432396.575206:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 00000000bf231f57/0xca72b3b33563e7a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.575213:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 00000000bf231f57/0xca72b3b33563e7a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.575219:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 00000000bf231f57/0xca72b3b33563e7a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432396.575230:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f79a0fee pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609313408:0@lo:101: 00000100:00100000:2.0:1787432396.575336:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432396.575361:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000007309ebef going to sleep for 11 seconds 00000100:00100000:1.0:1787432396.576120:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609313408 00000100:00100000:1.0:1787432396.576129:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609313408 00000100:00100000:1.0:1787432396.576188:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787432396.576197:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fc0e4f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+11:7443:x1874258609313408:12345-0@lo:101: 00010000:00010000:1.0:1787432396.576208:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432396.576220:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007126ade7/0xca72b3b33563e7ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e7a6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.576239:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007126ade7/0xca72b3b33563e7ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e7a6 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.576325:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007126ade7/0xca72b3b33563e7ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e7a6 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.576334:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007126ade7, rc 0) 00000100:00100000:1.0:1787432396.576382:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fc0e4f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:7443:x1874258609313408:12345-0@lo:101: Request processed in 187us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432396.576389:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787432396.576538:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f79a0fee pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609313408:0@lo:101: 00010000:00010000:2.0:1787432396.576563:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 00000000bf231f57/0xca72b3b33563e7a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e7ad expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.576571:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 00000000bf231f57/0xca72b3b33563e7a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e7ad expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432396.576704:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f79a0fee pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609313536:0@lo:501: 00000100:00100000:2.0:1787432396.576743:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432396.576777:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000007309ebef going to sleep for 11 seconds 00000100:00100000:1.0:1787432396.577139:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609313536 00000100:00100000:1.0:1787432396.577145:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609313536 00000100:00100000:1.0:1787432396.577207:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787432396.577215:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf9aaae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:7443:x1874258609313536:12345-0@lo:501: 00000100:00100000:1.0:1787432396.577434:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf9aaae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:7443:x1874258609313536:12345-0@lo:501: Request processed in 220us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432396.577442:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787432396.577760:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f79a0fee pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609313536:0@lo:501: 00000100:00100000:2.0:1787432396.577871:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f79a0fee pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609313664:0@lo:503: 00000100:00100000:2.0:1787432396.578001:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432396.578034:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000007309ebef going to sleep for 11 seconds 00000100:00100000:1.0:1787432396.578126:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609313664 00000100:00100000:1.0:1787432396.578132:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609313664 00000100:00100000:1.0:1787432396.578240:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787432396.578259:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa9738 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:7443:x1874258609313664:12345-0@lo:503: 00000100:00100000:1.0:1787432396.578351:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa9738 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:7443:x1874258609313664:12345-0@lo:503: Request processed in 93us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432396.578357:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787432396.578434:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f79a0fee pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609313664:0@lo:503: 00000040:00080000:2.0:1787432396.578701:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787432396.578788:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f79a0fee pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609313792:0@lo:502: 00000100:00100000:2.0:1787432396.578823:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432396.579144:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000007309ebef going to sleep for 11 seconds 00000100:00100000:3.0:1787432396.579367:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609313792 00000100:00100000:3.0:1787432396.579373:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609313792 00000100:00100000:0.0:1787432396.579512:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787432396.579521:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000949fb06c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:7443:x1874258609313792:12345-0@lo:502: 00000100:00100000:0.0:1787432396.579652:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000949fb06c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:7443:x1874258609313792:12345-0@lo:502: Request processed in 132us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.579659:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787432396.579749:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f79a0fee pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609313792:0@lo:502: 00000040:00080000:3.0:1787432396.580005:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787432396.580034:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1787432396.580049:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1787432396.580062:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1787432396.580075:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1787432396.580088:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1787432396.580102:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1787432396.580116:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1787432396.580128:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1787432396.580140:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1787432396.580153:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1787432396.580202:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1787432396.580221:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1787432396.580236:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1787432396.580266:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1787432396.580280:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1787432396.580293:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1787432396.580306:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1787432396.580334:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1787432396.580351:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1787432396.580365:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1787432396.580380:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1787432396.580394:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1787432396.580422:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009333579e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609313920:0@lo:502: 00000100:00100000:3.0:1787432396.580465:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432396.580848:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ae759562 going to sleep for 11 seconds 00000100:00100000:1.0:1787432396.580899:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609313920 00000100:00100000:1.0:1787432396.580905:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609313920 00000100:00100000:1.0:1787432396.580945:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787432396.580952:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025cbd8ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:7443:x1874258609313920:12345-0@lo:502: 00000100:00100000:1.0:1787432396.581050:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025cbd8ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:7443:x1874258609313920:12345-0@lo:502: Request processed in 97us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432396.581057:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787432396.581142:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009333579e pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609313920:0@lo:502: 00000040:00080000:3.0:1787432396.581227:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1787432396.581236:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1787432396.582591:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432396.582606:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432396.582608:0:7456:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787432396.582614:0:7456:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787432396.582617:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787432396.582630:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000011bd2745) 00000020:00000080:1.0:1787432396.582650:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1787432396.582656:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787432396.582882:0:7456:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787432396.582889:0:7456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xca72b3b33563e7bb 00000020:00000080:1.0:1787432396.583124:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787432396.583129:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432396.583134:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432396.583135:0:7456:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787432396.583138:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432396.583142:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432396.583143:0:7456:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787432396.583147:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787432396.583154:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000a5cc7775) 00000020:00000080:1.0:1787432396.583383:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1787432396.583395:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787432396.583397:0:7456:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787432396.583399:0:7456:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787432396.583405:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787432396.583453:0:7456:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003e771501 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787432396.583475:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000097555000) 00000020:00000080:1.0:1787432396.583486:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1787432396.583570:0:7456:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787432396.583577:0:7456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b33563e7d0 00000020:00000080:1.0:1787432396.583669:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787432396.583677:0:7456:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787432396.583681:0:7456:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xca72b3b33563e7d7 00080000:01000000:1.0:1787432396.583687:0:7456:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787432396.583690:0:7456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xca72b3b33563e7de 00080000:10000000:1.0:1787432396.584785:0:7456:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1787432396.585050:0:7456:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1787432396.655070:0:7456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1787432396.655438:0:7456:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1787432396.657881:0:7456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1787432396.658430:0:7456:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787432396.667287:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1787432396.667301:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432396.667311:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432396.667313:0:7456:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1787432396.667317:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432396.667322:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432396.667323:0:7456:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1787432396.667326:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787432396.667331:0:7456:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.124@tcp to nid 0x20000c0a8cc7c (192.168.204.124@tcp) 00000020:00000080:0.0:1787432396.667360:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787432396.667378:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000004089b478) 00000020:00000080:0.0:1787432396.667401:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787432396.667406:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787432396.668478:0:7456:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1787432396.668488:0:7456:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787432396.668499:0:7456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xca72b3b33563e7ec 00010000:00080000:0.0:1787432396.668539:0:7456:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003c5652d4@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.124@tcp at head 00010000:00010000:0.0:1787432396.670899:0:7456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1787432396.672419:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787432396.672435:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787432396.672594:0:7456:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787432396.672617:0:7456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b33563e7f3 00000100:00080000:1.0:1787432396.672627:0:7456:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787432396.672632:0:7456:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000003c5652d4 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432396.672669:0:7456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fd0587bb x1874258609314048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432396.672719:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd0587bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609314048:0@lo:38: 00000100:00100000:3.0:1787432396.672790:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787432396.672863:0:7456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1787432396.672922:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432396.672926:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432396.672937:0:7456:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787432396.672940:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787432396.672943:0:7456:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787432396.672944:0:7456:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787432396.672952:0:7456:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787432396.672954:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787432396.672957:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432396.672958:0:7456:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787432396.672960:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432396.672964:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432396.672966:0:7456:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787432396.672970:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787432396.673011:0:7456:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1787432396.673016:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609314048 00000100:00100000:0.0:1787432396.673023:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609314048 00000020:01000000:1.0:1787432396.673026:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432396.673029:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432396.673030:0:7456:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787432396.673033:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432396.673034:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432396.673036:0:7456:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787432396.673038:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787432396.673039:0:7456:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787432396.673056:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1787432396.673062:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1787432396.673062:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009333579e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874258609314048:12345-0@lo:38: 00000020:00000080:1.0:1787432396.673065:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432396.673066:0:7456:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787432396.673069:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00010000:00080000:0.0:1787432396.673085:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:0.0:1787432396.673113:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b33563e7fa 00000020:01000000:1.0:1787432396.673119:0:7443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 00000004:00100000:0.0:1787432396.673126:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787432396.673131:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:1.0:1787432396.673150:0:7443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787432396.673181:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 00000000bf231f57/0xca72b3b33563e7a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e7ad expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.673191:0:7443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: 00000000bf231f57/0xca72b3b33563e7a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e7ad expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432396.673198:0:7443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94842dfc5000 from 1 10000000:01000000:1.0:1787432396.673201:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787432396.673221:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.673239:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.673248:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432396.673262:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000741100c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609314304:0@lo:101: 00000100:00100000:1.0:1787432396.673295:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432396.673321:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000518d63dc going to sleep for 11 seconds 00000100:00100000:0.0:1787432396.673343:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609314304 00000100:00100000:0.0:1787432396.673347:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609314304 00000100:00100000:0.0:1787432396.673376:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787432396.673382:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e04873e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+12:7443:x1874258609314304:12345-0@lo:101: 00010000:00010000:0.0:1787432396.673393:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432396.673410:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d1306a1c/0xca72b3b33563e808 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e801 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.673429:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d1306a1c/0xca72b3b33563e808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e801 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.673438:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d1306a1c/0xca72b3b33563e808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e801 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.673446:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d1306a1c, rc 0) 00000100:00100000:0.0:1787432396.673492:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e04873e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+13:7443:x1874258609314304:12345-0@lo:101: Request processed in 111us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.673499:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787432396.673582:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000741100c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609314304:0@lo:101: 00010000:00010000:1.0:1787432396.673595:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e801 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e808 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.673603:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e801 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e808 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432396.673714:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006e73a445 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609314176:0@lo:400: 00000100:00100000:2.0:1787432396.673746:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432396.674002:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609314176 00000100:00100000:0.0:1787432396.674007:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609314176 00000100:00100000:0.0:1787432396.674036:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432396.674042:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000463edf28 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609314176:12345-0@lo:400: 00000100:00100000:0.0:1787432396.674092:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000463edf28 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609314176:12345-0@lo:400: Request processed in 51us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.674098:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787432396.674159:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006e73a445 x1874258609314176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432396.674231:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006e73a445 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609314176:0@lo:400: 00000100:00100000:1.0:1787432396.674564:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000741100c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609314432:0@lo:256: 00000100:00100000:1.0:1787432396.674599:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432396.674657:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000518d63dc going to sleep for 11 seconds 00000100:00100000:0.0:1787432396.674692:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609314432 00000100:00100000:0.0:1787432396.674696:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609314432 00000100:00100000:0.0:1787432396.674749:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787432396.674756:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a478a6e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+13:7443:x1874258609314432:12345-0@lo:256: 20000000:01000000:0.0:1787432396.674768:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787432396.674782:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787432396.674785:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787432396.674860:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a478a6e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+13:7443:x1874258609314432:12345-0@lo:256: Request processed in 105us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.674874:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787432396.674937:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000741100c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609314432:0@lo:256: 10000000:01000000:3.0:1787432396.675523:0:7443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787432396.675540:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e801 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e808 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432396.675563:0:7443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e808 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432396.675571:0:7443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94842dfc5000 from 1 10000000:01000000:3.0:1787432396.675574:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787432396.675597:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 00000000eda33c0a/0xca72b3b33563e80f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432396.675605:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 00000000eda33c0a/0xca72b3b33563e80f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432396.675612:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 00000000eda33c0a/0xca72b3b33563e80f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432396.675625:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c318d49c pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609314560:0@lo:101: 00000100:00100000:3.0:1787432396.676319:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432396.676356:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 0000000090a9cb43 going to sleep for 11 seconds 00000100:00100000:2.0:1787432396.676433:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609314560 00000100:00100000:2.0:1787432396.676439:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609314560 00000100:00100000:2.0:1787432396.676611:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787432396.676627:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027565127 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+13:7443:x1874258609314560:12345-0@lo:101: 00010000:00010000:2.0:1787432396.676638:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432396.676649:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d21990e0/0xca72b3b33563e816 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e80f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.676669:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d21990e0/0xca72b3b33563e816 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e80f expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.676678:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d21990e0/0xca72b3b33563e816 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e80f expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432396.676687:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d21990e0, rc 0) 00000100:00100000:2.0:1787432396.676725:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027565127 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:7443:x1874258609314560:12345-0@lo:101: Request processed in 99us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432396.676731:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787432396.677023:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c318d49c pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609314560:0@lo:101: 00010000:00010000:3.0:1787432396.677038:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 00000000eda33c0a/0xca72b3b33563e80f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e816 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432396.677045:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 00000000eda33c0a/0xca72b3b33563e80f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e816 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432396.677137:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c318d49c pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609314688:0@lo:501: 00000100:00100000:3.0:1787432396.677193:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432396.677206:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 0000000090a9cb43 going to sleep for 11 seconds 00000100:00100000:0.0:1787432396.677498:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609314688 00000100:00100000:0.0:1787432396.677504:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609314688 00000100:00100000:0.0:1787432396.677534:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787432396.677540:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c13e244f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:7443:x1874258609314688:12345-0@lo:501: 00000100:00100000:0.0:1787432396.677642:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c13e244f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:7443:x1874258609314688:12345-0@lo:501: Request processed in 102us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.677649:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787432396.677725:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c318d49c pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609314688:0@lo:501: 00000100:00100000:3.0:1787432396.677752:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c318d49c pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609314816:0@lo:503: 00000100:00100000:3.0:1787432396.677792:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432396.677821:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 0000000090a9cb43 going to sleep for 11 seconds 00000100:00100000:0.0:1787432396.677980:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609314816 00000100:00100000:0.0:1787432396.677984:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609314816 00000100:00100000:0.0:1787432396.678014:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787432396.678021:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b14ce49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:7443:x1874258609314816:12345-0@lo:503: 00000040:00080000:0.0:1787432396.678052:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787432396.678091:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b14ce49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:7443:x1874258609314816:12345-0@lo:503: Request processed in 71us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.678098:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787432396.678138:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c318d49c pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609314816:0@lo:503: 00000040:00080000:0.0:1787432396.678422:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432396.678470:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1787432396.678540:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432396.679240:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1787432396.679278:0:7443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787432396.679299:0:7443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787432396.679314:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 00000000eda33c0a/0xca72b3b33563e80f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e816 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.679324:0:7443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: 00000000eda33c0a/0xca72b3b33563e80f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e816 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432396.679376:0:7443:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787432396.679378:0:7443:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94842dfc5000 10000000:01000000:0.0:1787432396.679381:0:7443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94842dfc5000 10000000:01000000:0.0:1787432396.679385:0:7443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787432396.679389:0:7443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94842dfc5000 from 1 10000000:01000000:0.0:1787432396.679391:0:7443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787432396.679418:0:7443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 000000004c2ea8a7/0xca72b3b33563e81d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.679425:0:7443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 000000004c2ea8a7/0xca72b3b33563e81d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.679432:0:7443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 000000004c2ea8a7/0xca72b3b33563e81d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432396.679449:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f096581f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609314944:0@lo:101: 00000100:00100000:0.0:1787432396.679495:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432396.679517:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5fc9b18 going to sleep for 11 seconds 00000100:00100000:0.0:1787432396.679537:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609314944 00000100:00100000:0.0:1787432396.679542:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609314944 00000100:00100000:0.0:1787432396.679585:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787432396.679592:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b1025f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:7443:x1874258609314944:12345-0@lo:101: 00010000:00010000:0.0:1787432396.679601:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432396.679611:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007c456bbf/0xca72b3b33563e824 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e81d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.679629:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007c456bbf/0xca72b3b33563e824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e81d expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.679650:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007c456bbf/0xca72b3b33563e824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e81d expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.679658:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007c456bbf, rc 0) 00000100:00100000:0.0:1787432396.679691:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b1025f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:7443:x1874258609314944:12345-0@lo:101: Request processed in 100us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.679698:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787432396.679739:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f096581f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609314944:0@lo:101: 00010000:00010000:0.0:1787432396.679750:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 000000004c2ea8a7/0xca72b3b33563e81d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e824 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.679757:0:7443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 000000004c2ea8a7/0xca72b3b33563e81d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e824 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432396.679829:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f096581f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609315072:0@lo:501: 00000100:00100000:0.0:1787432396.679851:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432396.679863:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5fc9b18 going to sleep for 11 seconds 00000100:00100000:0.0:1787432396.679874:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609315072 00000100:00100000:0.0:1787432396.679877:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609315072 00000100:00100000:0.0:1787432396.679895:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787432396.679900:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008dd7761d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:7443:x1874258609315072:12345-0@lo:501: 00000100:00100000:0.0:1787432396.679978:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008dd7761d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:7443:x1874258609315072:12345-0@lo:501: Request processed in 78us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.679985:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787432396.680015:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f096581f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609315072:0@lo:501: 00000100:00100000:0.0:1787432396.680039:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f096581f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609315200:0@lo:503: 00000100:00100000:0.0:1787432396.680080:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432396.680091:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5fc9b18 going to sleep for 11 seconds 00000100:00100000:0.0:1787432396.680102:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609315200 00000100:00100000:0.0:1787432396.680105:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609315200 00000100:00100000:0.0:1787432396.680123:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787432396.680128:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1ec503d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:7443:x1874258609315200:12345-0@lo:503: 00000100:00100000:0.0:1787432396.680230:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1ec503d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:7443:x1874258609315200:12345-0@lo:503: Request processed in 101us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.680237:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787432396.680276:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f096581f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609315200:0@lo:503: 00000040:00080000:0.0:1787432396.680501:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787432396.680573:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f096581f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609315328:0@lo:502: 00000100:00100000:0.0:1787432396.680610:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432396.680623:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dcd4ccfc going to sleep for 11 seconds 00000100:00100000:0.0:1787432396.680637:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609315328 00000100:00100000:0.0:1787432396.680640:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609315328 00000100:00100000:0.0:1787432396.680661:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787432396.680667:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b263e4f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:7443:x1874258609315328:12345-0@lo:502: 00000100:00100000:0.0:1787432396.680753:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b263e4f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:7443:x1874258609315328:12345-0@lo:502: Request processed in 86us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.680760:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787432396.680800:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f096581f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609315328:0@lo:502: 00000100:00080000:3.0:1787432396.682023:0:6518:0:(import.c:65:import_set_state_nolock()) 000000007bb22ba5 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432396.682101:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009333579e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1874258609314048:12345-0@lo:38: Request processed in 9037us (9311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432396.682116:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432396.682342:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787432396.682350:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787432396.682358:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787432396.682363:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787432396.682365:0:3640:0:(import.c:65:import_set_state_nolock()) 000000003c5652d4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787432396.682375:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd0587bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609314048:0@lo:38: 00000100:00100000:1.0:1787432396.682564:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000094734e7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609315456:0@lo:41: 00000100:00100000:1.0:1787432396.682603:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432396.682685:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609315456 00000100:00100000:3.0:1787432396.682690:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609315456 00000100:00100000:3.0:1787432396.682725:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787432396.682732:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd0587bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1874258609315456:12345-0@lo:41: 00000004:00000024:3.0:1787432396.682767:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1787432396.682800:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd0587bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1874258609315456:12345-0@lo:41: Request processed in 70us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432396.682814:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787432396.683103:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000094734e7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609315456:0@lo:41: 00000040:00080000:0.0:1787432396.684134:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787432396.684335:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787432396.684351:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787432396.684381:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787432396.684394:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787432396.684415:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787432396.684427:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787432396.684439:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787432396.684451:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787432396.684464:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787432396.684478:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787432396.684489:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787432396.684500:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787432396.684513:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787432396.684525:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787432396.684538:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787432396.684562:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787432396.684576:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787432396.684588:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787432396.684615:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787432396.684631:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787432396.684643:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787432396.684656:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787432396.684668:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787432396.684680:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787432396.684692:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787432396.684705:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787432396.684717:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1787432396.684756:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f096581f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609315584:0@lo:502: 00000100:00100000:0.0:1787432396.685113:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432396.685227:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dcd4ccfc going to sleep for 11 seconds 00000100:00100000:2.0:1787432396.685431:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609315584 00000100:00100000:2.0:1787432396.685439:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609315584 00000100:00100000:2.0:1787432396.685524:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787432396.685533:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fee1306f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:7443:x1874258609315584:12345-0@lo:502: 00000100:00100000:2.0:1787432396.685678:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fee1306f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:7443:x1874258609315584:12345-0@lo:502: Request processed in 146us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432396.685686:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787432396.685777:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f096581f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609315584:0@lo:502: 00000040:00080000:3.0:1787432396.685838:0:7443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787432396.685847:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787432396.686319:0:7462:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787432396.686332:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000e3fde4e6) 00000020:00000080:3.0:1787432396.686350:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787432396.686436:0:7462:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003e771501 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787432396.686441:0:7462:0:(tgt_mount.c:187:server_put_mount()) put mount 000000003e771501 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787432396.686443:0:7462:0:(obd_mount.c:710:lustre_put_lsi()) put 000000003e771501 3 00010000:00080000:3.0:1787432396.686474:0:7462:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000246a2711@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.124@tcp at head 00010000:00010000:3.0:1787432396.688143:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1787432396.688433:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787432396.688471:0:7462:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787432396.688484:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xca72b3b33563e832 00000100:00080000:3.0:1787432396.688493:0:7462:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787432396.688498:0:7462:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000246a2711 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432396.688531:0:7462:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000898290d6 x1874258609315712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787432396.688595:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000898290d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874258609315712:0@lo:38: 00000100:00100000:1.0:1787432396.688670:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432396.688764:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609315712 00000100:00100000:0.0:1787432396.688771:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609315712 00000100:00100000:0.0:1787432396.688804:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432396.688811:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000581fa1cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874258609315712:12345-0@lo:38: 00010000:00080000:0.0:1787432396.688831:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:0.0:1787432396.688877:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xca72b3b33563e839 00000004:00100000:0.0:1787432396.688891:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787432396.688917:0:6513:0:(import.c:65:import_set_state_nolock()) 000000009bf2554a : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787432396.688978:0:7462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787432396.689071:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000581fa1cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874258609315712:12345-0@lo:38: Request processed in 259us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.689079:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787432396.689141:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000898290d6 x1874258609315712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432396.689151:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787432396.689158:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000040:00080000:0.0:1787432396.689413:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:0.0:1787432396.689528:0:7463:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00080000:1.0:1787432396.689666:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787432396.689672:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787432396.689674:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000246a2711 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787432396.689682:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000898290d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874258609315712:0@lo:38: 00000020:01000000:1.0:1787432396.689711:0:7443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787432396.689740:0:7443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787432396.689808:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 000000004c2ea8a7/0xca72b3b33563e81d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e824 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432396.689818:0:7443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: 000000004c2ea8a7/0xca72b3b33563e81d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e824 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787432396.689865:0:7443:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787432396.689868:0:7443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787432396.689869:0:7443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432396.689871:0:7443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432396.689872:0:7443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432396.689873:0:7443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432396.689874:0:7443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787432396.689876:0:7443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787432396.689877:0:7443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787432396.689883:0:7443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432396.689885:0:7443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787432396.689887:0:7443:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1787432396.689890:0:7443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787432396.689891:0:7443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787432396.689892:0:7443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432396.689893:0:7443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432396.689894:0:7443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432396.689895:0:7443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432396.689896:0:7443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787432396.689897:0:7443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787432396.689897:0:7443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787432396.689898:0:7443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432396.689899:0:7443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787432396.689916:0:7443:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787432396.689929:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b02277be pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609315840:0@lo:253: 00000100:00100000:1.0:1787432396.689978:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432396.690011:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ddb67ef going to sleep for 11 seconds 00000100:00100000:0.0:1787432396.690059:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609315840 00000100:00100000:0.0:1787432396.690064:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609315840 00000100:00100000:0.0:1787432396.690143:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787432396.690151:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf424bce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:7443:x1874258609315840:12345-0@lo:253: 20000000:01000000:0.0:1787432396.690190:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787432396.690204:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1787432396.695035:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787432396.695147:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787432396.695324:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787432396.697346:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf424bce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:7443:x1874258609315840:12345-0@lo:253: Request processed in 7190us (7363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.697361:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787432396.697516:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b02277be pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:7443:1874258609315840:0@lo:253: 10000000:01000000:1.0:1787432396.697532:0:7443:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787432396.697536:0:7443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787432396.697538:0:7443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787432396.697539:0:7443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432396.697540:0:7443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432396.697541:0:7443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432396.697557:0:7443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432396.697559:0:7443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787432396.697561:0:7443:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787432396.697562:0:7443:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787432396.697564:0:7443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432396.697565:0:7443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787432396.697579:0:7443:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787432396.699073:0:6529:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787432396.699084:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787432396.699424:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000090b8c0e4/0xca72b3b33563e840 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432396.699443:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001539c1e5/0xca72b3b33563e759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e752 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432396.699609:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d1306a1c/0xca72b3b33563e808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e801 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432396.699616:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000090b8c0e4/0xca72b3b33563e840 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432396.699659:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d1306a1c/0xca72b3b33563e808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e801 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432396.699675:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d1306a1c/0xca72b3b33563e808 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e801 expref: 14 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432396.699689:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014c1270e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1874258609315968:0@lo:104: 00000100:00100000:3.0:1787432396.699752:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432396.699811:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609315968 00010000:00010000:3.0:1787432396.699814:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001539c1e5/0xca72b3b33563e759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e752 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432396.699819:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609315968 00010000:00010000:3.0:1787432396.699822:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001539c1e5/0xca72b3b33563e759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e752 expref: 14 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432396.699828:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009db7e24d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1874258609316096:0@lo:104: 00000100:00100000:3.0:1787432396.699848:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432396.699868:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609316096 00000100:00100000:0.0:1787432396.699872:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609316096 00000100:00100000:3.0:1787432396.699873:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set 0000000056ee796f going to sleep for 11 seconds 00000100:00100000:0.0:1787432396.699887:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432396.699894:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c63ad90 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6529:x1874258609315968:12345-0@lo:104: 00010000:00010000:0.0:1787432396.699904:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e808 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.700044:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787432396.700055:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c63ad90 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6529:x1874258609315968:12345-0@lo:104: Request processed in 162us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.700063:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432396.700081:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432396.700088:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055fab94a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6529:x1874258609316096:12345-0@lo:104: 00010000:00010000:0.0:1787432396.700095:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: 00000000af3438a4/0xca72b3b33563e752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e759 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.700132:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787432396.700136:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055fab94a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6529:x1874258609316096:12345-0@lo:104: Request processed in 50us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.700142:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787432396.700158:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787432396.700185:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e808 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.700193:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009f90788d already unused, calling callback (000000002e80036b) 10000000:00010000:0.0:1787432396.700196:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e808 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.700204:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e808 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432396.700211:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e808 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432396.700218:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1787432396.700322:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014c1270e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1874258609315968:0@lo:104: 00000100:00100000:3.0:1787432396.700330:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009db7e24d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1874258609316096:0@lo:104: 00010000:00010000:3.0:1787432396.700350:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000090b8c0e4/0xca72b3b33563e840 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.700493:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e801 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e808 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.700510:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787432396.700559:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cdff4cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609316224:0@lo:103: 00000100:00100000:2.0:1787432396.700591:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432396.700691:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e801 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e808 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.700699:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: 000000009f90788d/0xca72b3b33563e801 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e808 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.700715:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432396.700718:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: 00000000af3438a4/0xca72b3b33563e752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e759 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.700723:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000af3438a4 already unused, calling callback (000000002e80036b) 10000000:00010000:0.0:1787432396.700726:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: 00000000af3438a4/0xca72b3b33563e752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e759 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.700732:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: 00000000af3438a4/0xca72b3b33563e752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e759 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432396.700742:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: 00000000af3438a4/0xca72b3b33563e752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e759 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432396.700747:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432396.700761:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: 00000000af3438a4/0xca72b3b33563e752 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e759 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.700768:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432396.700783:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: 00000000af3438a4/0xca72b3b33563e752 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e759 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.700788:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: 00000000af3438a4/0xca72b3b33563e752 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e759 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.700810:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432396.700812:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432396.700813:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432396.700819:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432396.700829:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432396.700839:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f710c387 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609316352:0@lo:103: 00000100:00100000:0.0:1787432396.700869:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432396.701211:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609316224 00000100:00100000:0.0:1787432396.701217:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609316224 00010000:00010000:0.0:1787432396.701237:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d1306a1c/0xca72b3b33563e808 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e801 expref: 15 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432396.701303:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609316352 00000100:00100000:0.0:1787432396.701307:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609316352 00010000:00010000:0.0:1787432396.701318:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001539c1e5/0xca72b3b33563e759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e752 expref: 16 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432396.701331:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432396.701338:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ecab9a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:3642:x1874258609316224:12345-0@lo:103: 00010000:00010000:0.0:1787432396.701348:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432396.701353:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d1306a1c/0xca72b3b33563e808 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e801 expref: 16 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.701362:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d1306a1c/0xca72b3b33563e808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e801 expref: 16 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.701374:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d1306a1c/0xca72b3b33563e808 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e801 expref: 16 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432396.701384:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787432396.701392:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1787432396.701398:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432396.701439:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ecab9a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:3642:x1874258609316224:12345-0@lo:103: Request processed in 101us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.701445:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787432396.701497:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cdff4cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609316224:0@lo:103: 00000100:00100000:0.0:1787432396.701529:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432396.701536:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5bdcda6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:3644:x1874258609316352:12345-0@lo:103: 00010000:00010000:0.0:1787432396.701559:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432396.701563:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001539c1e5/0xca72b3b33563e759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e752 expref: 14 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.701571:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001539c1e5/0xca72b3b33563e759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e752 expref: 14 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.701580:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001539c1e5/0xca72b3b33563e759 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e752 expref: 14 pid: 6507 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.701590:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000090b8c0e4/0xca72b3b33563e840 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.701597:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000090b8c0e4/0xca72b3b33563e840 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787432396.701609:0:6499:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005818009s 00010000:00010000:0.0:1787432396.701613:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000090b8c0e4/0xca72b3b33563e840 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.701619:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000090b8c0e4/0xca72b3b33563e840 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.701635:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000090b8c0e4/0xca72b3b33563e840 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.701641:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000090b8c0e4/0xca72b3b33563e840 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.701646:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000090b8c0e4 already unused, calling callback (0000000033074501) 00010000:00010000:0.0:1787432396.701649:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000090b8c0e4/0xca72b3b33563e840 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.701656:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000090b8c0e4/0xca72b3b33563e840 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.701675:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000090b8c0e4/0xca72b3b33563e840 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432396.701685:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432396.701710:0:6529:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000090b8c0e4/0xca72b3b33563e840 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432396.701718:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000090b8c0e4/0xca72b3b33563e840 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432396.701721:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5bdcda6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+13:3644:x1874258609316352:12345-0@lo:103: Request processed in 187us (852us total) trans 0 rc 0/0 00010000:00010000:3.0:1787432396.701724:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000090b8c0e4/0xca72b3b33563e840 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432396.701728:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432396.701779:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f710c387 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609316352:0@lo:103: 00080000:10000000:1.0:1787432396.704663:0:7443:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1787432396.704832:0:7443:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787432396.705148:0:7443:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787432396.705386:0:7443:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787432396.705611:0:7443:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787432396.705778:0:7443:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1787432396.706847:0:7443:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787432396.707147:0:7443:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1787432396.707501:0:7443:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1787432396.707679:0:7443:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1787432396.707863:0:7443:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1787432396.708676:0:7443:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1787432396.710072:0:7443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1787432396.710422:0:7469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1787432396.710475:0:7469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009db7e24d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7469:1874258609316480:0@lo:700: 00000100:00100000:3.0:1787432396.710564:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432396.710598:0:7469:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc07eb4f going to sleep for 11 seconds 00000040:01000000:0.0:1787432396.710652:0:7443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000020:00080000:1.0:1787432396.710881:0:7468:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1787432396.710885:0:7468:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787432396.711105:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033b466ad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1874258609316608:0@lo:1000: 00000100:00100000:0.0:1787432396.711146:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432396.711211:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 0000000029a7e44a going to sleep for 11 seconds 00000100:00100000:1.0:1787432396.711280:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609316608 00000100:00100000:1.0:1787432396.711288:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609316608 00000100:00100000:1.0:1787432396.711338:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432396.711347:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063bb9fd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1874258609316608:12345-0@lo:1000: 00000100:00100000:1.0:1787432396.711424:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063bb9fd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1874258609316608:12345-0@lo:1000: Request processed in 79us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432396.711432:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432396.711576:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033b466ad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1874258609316608:0@lo:1000: 00000040:01000000:0.0:1787432396.711610:0:7470:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1787432396.711633:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033b466ad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1874258609316736:0@lo:700: 00000100:00100000:0.0:1787432396.711658:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432396.711691:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 000000009f5f9499 going to sleep for 11 seconds 00000100:00100000:1.0:1787432396.712333:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609316736 00000100:00100000:1.0:1787432396.712340:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609316736 00000100:00100000:1.0:1787432396.712381:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432396.712388:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000997c37b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7470:x1874258609316736:12345-0@lo:700: 00000100:00100000:1.0:1787432396.712440:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000997c37b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7470:x1874258609316736:12345-0@lo:700: Request processed in 52us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432396.712447:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432396.712508:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033b466ad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1874258609316736:0@lo:700: 00000100:00100000:0.0:1787432396.712576:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033b466ad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7470:1874258609316864:0@lo:900: 00000100:00100000:0.0:1787432396.712607:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432396.712630:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 000000009f5f9499 going to sleep for 11 seconds 00000040:01000000:3.0:1787432396.712701:0:7443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1787432396.712827:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787432396.713020:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609316864 00000100:00100000:1.0:1787432396.713025:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609316864 00000100:00100000:1.0:1787432396.713059:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432396.713071:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b810ff06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7470:x1874258609316864:12345-0@lo:900: 00000100:00100000:1.0:1787432396.713110:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b810ff06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7470:x1874258609316864:12345-0@lo:900: Request processed in 40us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432396.713116:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787432396.713200:0:7470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000033b466ad x1874258609316864/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787432412 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432396.713210:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033b466ad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7470:1874258609316864:0@lo:900: 00000100:00100000:0.0:1787432396.713353:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033b466ad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1874258609316992:0@lo:1000: 00000100:00100000:0.0:1787432396.713384:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432396.713402:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d3d0d4e4 going to sleep for 11 seconds 00000100:00100000:1.0:1787432396.713459:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609316992 00000100:00100000:1.0:1787432396.713463:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609316992 00000100:00100000:1.0:1787432396.713490:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787432396.713496:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048f20e5c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1874258609316992:12345-0@lo:1000: 00000100:00100000:1.0:1787432396.713576:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048f20e5c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1874258609316992:12345-0@lo:1000: Request processed in 81us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432396.713583:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787432396.713672:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609316480 00000100:00100000:2.0:1787432396.713679:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609316480 00000100:00100000:2.0:1787432396.713712:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787432396.713725:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014c1270e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7469:x1874258609316480:12345-0@lo:700: 00000100:00100000:0.0:1787432396.714031:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033b466ad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1874258609316992:0@lo:1000: 00000004:00080000:0.0:1787432396.714074:0:7470:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000009f5f9499 with version 0 00000020:00100000:0.0:1787432396.714089:0:7470:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787432396.714094:0:7470:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000033b466ad x1874258609317248/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787432396.714107:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033b466ad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1874258609317248:0@lo:1000: 00000100:00100000:0.0:1787432396.714133:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432396.714238:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 000000002a285952 going to sleep for 11 seconds 00000100:00100000:2.0:1787432396.714908:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609317248 00000100:00100000:2.0:1787432396.714914:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609317248 00000100:00100000:2.0:1787432396.715028:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787432396.715036:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec85313d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1874258609317248:12345-0@lo:1000: 00000004:00000080:3.0:1787432396.715771:0:7443:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787432396.715786:0:7443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1787432396.716453:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787432396.717822:0:7443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787432396.718695:0:7443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787432396.718762:0:7443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1787432396.719101:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787432396.719628:0:7443:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787432396.721880:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000001:00080000:1.0:1787432396.722215:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:3.0:1787432396.722471:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787432396.722631:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787432396.722778:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787432396.722959:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787432396.723205:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787432396.723564:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787432396.723731:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787432396.723876:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787432396.724035:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787432396.724198:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787432396.724350:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787432396.724521:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787432396.724675:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787432396.724815:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787432396.724999:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787432396.725340:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787432396.725476:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787432396.725629:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787432396.725772:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787432396.725898:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787432396.726047:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787432396.726214:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787432396.726356:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787432396.726863:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 40000000:02000000:0.0:1787432396.727018:0:6520:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:3.0:1787432396.730107:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787432396.730491:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787432396.730669:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787432396.730805:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787432396.732233:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787432396.732499:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787432396.732664:0:7443:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787432396.732868:0:7443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1787432396.733125:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec85313d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1874258609317248:12345-0@lo:1000: Request processed in 18086us (18988us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787432396.733138:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1787432396.733280:0:7470:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1787432396.733285:0:7470:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787432396.733300:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033b466ad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1874258609317248:0@lo:1000: 00000100:00100000:1.0:1787432396.733387:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b02277be pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1874258609317376:0@lo:1000: 00000100:00100000:1.0:1787432396.733429:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432396.733477:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054325fe2 going to sleep for 11 seconds 00000100:00100000:2.0:1787432396.733600:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609317376 00000100:00100000:2.0:1787432396.733607:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609317376 00000100:00100000:2.0:1787432396.733647:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432396.733656:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000282ce97a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7470:x1874258609317376:12345-0@lo:1000: 00000100:00100000:2.0:1787432396.733737:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000282ce97a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7470:x1874258609317376:12345-0@lo:1000: Request processed in 83us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432396.733744:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787432396.734268:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b02277be pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1874258609317376:0@lo:1000: 00000040:00080000:1.0:1787432396.734291:0:7470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1787432396.734322:0:7470:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000002bb89f8c with version 1 00000004:00080000:2.0:1787432396.738073:0:7459:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000006a92b236 version 1 rpc_version 1 00000020:00100000:2.0:1787432396.738124:0:7459:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787432396.738134:0:7459:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000081a53163 x1874258609317632/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787432396.738158:0:7459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000081a53163 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7459:1874258609317632:0@lo:1000: 00000100:00100000:2.0:1787432396.738317:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432396.738364:0:7459:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c8d4edac going to sleep for 11 seconds 00000100:00100000:2.0:1787432396.738383:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609317632 00000100:00100000:2.0:1787432396.738391:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609317632 00000100:00100000:2.0:1787432396.738445:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787432396.738453:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000adcd8836 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7459:x1874258609317632:12345-0@lo:1000: 00000100:00100000:0.0:1787432396.743515:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014c1270e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7469:x1874258609316480:12345-0@lo:700: Request processed in 29782us (32943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432396.743538:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787432396.743959:0:7469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009db7e24d x1874258609316480/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787432412 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432396.743989:0:7469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009db7e24d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7469:1874258609316480:0@lo:700: 40000000:02000000:2.0:1787432396.744002:0:7469:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000040:00080000:1.0:1787432396.746046:0:7470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787432396.746131:0:7470:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:1.0:1787432396.750057:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1787432396.750386:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000adcd8836 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7459:x1874258609317632:12345-0@lo:1000: Request processed in 11931us (12066us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787432396.750401:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000001:00080000:0.0:1787432396.752019:0:7443:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787432396.752063:0:7443:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb0c1c1ca3988 00100000:10000000:0.0:1787432396.752088:0:7443:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1787432396.752879:0:7443:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787432396.752911:0:7443:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.124@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787432396.752942:0:7443:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787432396.752970:0:7443:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1787432396.753721:0:7443:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787432396.753906:0:7443:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000004:00080000:2.0:1787432396.761822:0:7459:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1787432396.761831:0:7459:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787432396.761851:0:7459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000081a53163 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7459:1874258609317632:0@lo:1000: 00000040:00080000:1.0:1787432396.813401:0:7469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787432396.829070:0:7469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787432396.829155:0:7469:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787432396.829188:0:7469:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1787432397.009430:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432398.027691:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432399.056118:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432400.079279:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432401.100758:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787432401.498102:0:7714:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787432401.868072:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b02277be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609317760:0@lo:400: 00000100:00100000:1.0:1787432401.868149:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432401.868231:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432401.868249:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061ef4ad7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609318144:0@lo:400: 00000100:00100000:1.0:1787432401.868278:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432401.868319:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087ace39a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609317888:0@lo:400: 00000100:00100000:1.0:1787432401.868348:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432401.868375:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432401.868383:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c75a1b86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609318016:0@lo:400: 00000100:00100000:3.0:1787432401.868386:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609318144 00000100:00100000:3.0:1787432401.868394:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609318144 00000100:00100000:1.0:1787432401.868412:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432401.868436:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609317888 00000100:00100000:3.0:1787432401.868440:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609317888 00000100:00100000:3.0:1787432401.868471:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432401.868481:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffef3a28 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609318144:12345-0@lo:400: 00000100:00100000:2.0:1787432401.868492:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609317760 00000100:00100000:2.0:1787432401.868498:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609317760 00000100:00100000:2.0:1787432401.868537:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787432401.868541:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffef3a28 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609318144:12345-0@lo:400: Request processed in 61us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432401.868548:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056d84362 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+13:3644:x1874258609317760:12345-0@lo:400: 00000100:00100000:3.0:1787432401.868564:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432401.868587:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787432401.868591:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056d84362 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+13:3644:x1874258609317760:12345-0@lo:400: Request processed in 45us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432401.868597:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eeef7060 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609317888:12345-0@lo:400: 00000100:00100000:2.0:1787432401.868601:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787432401.868641:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eeef7060 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609317888:12345-0@lo:400: Request processed in 47us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432401.868646:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787432401.868728:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000087ace39a x1874258609317888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432401.868743:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087ace39a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609317888:0@lo:400: 00000100:00100000:1.0:1787432401.869044:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609318016 00000100:00100000:1.0:1787432401.869049:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609318016 00000100:00100000:1.0:1787432401.869088:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787432401.869095:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000741100c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609318016:12345-0@lo:400: 00000100:00100000:1.0:1787432401.869153:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000741100c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609318016:12345-0@lo:400: Request processed in 58us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432401.869159:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787432401.869205:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432401.869217:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c913ffe3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609318272:0@lo:41: 00000100:00100000:2.0:1787432401.869231:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c75a1b86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609318016:0@lo:400: 00000100:00100000:1.0:1787432401.869685:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787432401.870602:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000061ef4ad7 x1874258609318144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432401.870630:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061ef4ad7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609318144:0@lo:400: 00000100:00100000:1.0:1787432401.870643:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b02277be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609317760:0@lo:400: 00000100:00100000:0.0:1787432401.875391:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609318272 00000100:00100000:0.0:1787432401.875418:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609318272 00000100:00100000:0.0:1787432401.875547:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787432401.875558:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087ace39a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609318272:12345-0@lo:41: 00000004:00000024:0.0:1787432401.875597:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1787432401.875691:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087ace39a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609318272:12345-0@lo:41: Request processed in 135us (6006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432401.875699:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432401.875814:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c913ffe3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609318272:0@lo:41: 00010000:00010000:0.0:1787432402.125323:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787432402.519486:0:7767:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432402.521518:0:7767:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787432403.147350:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787432403.915587:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787432403.915596:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94842dfc5000 from 4 10000000:01000000:0.0:1787432403.915611:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787432403.916923:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 00000000f8fb8b77/0xca72b3b33563e847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432403.916939:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 00000000f8fb8b77/0xca72b3b33563e847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432403.916951:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 00000000f8fb8b77/0xca72b3b33563e847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432403.916992:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609318400:0@lo:101: 00000100:00100000:0.0:1787432403.917057:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432403.917218:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609318400 00000100:00100000:3.0:1787432403.917227:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609318400 00000100:00100000:0.0:1787432403.917297:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f4d75f9d going to sleep for 11 seconds 00000100:00100000:3.0:1787432403.922263:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787432403.922288:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047d0388a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+13:6511:x1874258609318400:12345-0@lo:101: 00010000:00010000:3.0:1787432403.922308:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432403.922328:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b90af341/0xca72b3b33563e84e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e847 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432403.922589:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b90af341/0xca72b3b33563e84e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e847 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432403.922612:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b90af341/0xca72b3b33563e84e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e847 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432403.922623:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b90af341, rc 0) 00000100:00100000:3.0:1787432403.922969:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047d0388a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:6511:x1874258609318400:12345-0@lo:101: Request processed in 693us (5910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432403.922977:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787432403.923105:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609318400:0@lo:101: 00010000:00010000:0.0:1787432403.923123:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 00000000f8fb8b77/0xca72b3b33563e847 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e84e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432403.923133:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 00000000f8fb8b77/0xca72b3b33563e847 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e84e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432403.923242:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609318528:0@lo:256: 00000100:00100000:0.0:1787432403.923285:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432403.923318:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f4d75f9d going to sleep for 11 seconds 00000100:00100000:1.0:1787432403.923674:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609318528 00000100:00100000:1.0:1787432403.923682:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609318528 00000100:00100000:1.0:1787432403.923725:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787432403.923733:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000060c5cc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:6511:x1874258609318528:12345-0@lo:256: 20000000:01000000:1.0:1787432403.923749:0:6507:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787432403.923767:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787432403.923770:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787432403.924105:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000060c5cc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:6511:x1874258609318528:12345-0@lo:256: Request processed in 372us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432403.924113:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787432403.924436:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609318528:0@lo:256: 10000000:01000000:0.0:1787432403.924484:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787432403.924491:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 00000000f8fb8b77/0xca72b3b33563e847 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e84e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432403.924501:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: 00000000f8fb8b77/0xca72b3b33563e847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e84e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432403.924511:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787432403.924513:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948411b1c000 from 21 10000000:01000000:0.0:1787432403.924516:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787432403.924541:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 00000000a1cb10b0/0xca72b3b33563e855 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432403.924558:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 00000000a1cb10b0/0xca72b3b33563e855 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432403.924567:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 00000000a1cb10b0/0xca72b3b33563e855 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432403.924581:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609318656:0@lo:101: 00000100:00100000:0.0:1787432403.924625:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432403.924979:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f4d75f9d going to sleep for 11 seconds 00000100:00100000:1.0:1787432403.929984:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609318656 00000100:00100000:1.0:1787432403.930000:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609318656 00000100:00100000:1.0:1787432403.930140:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787432403.930150:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b1fe765 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:6511:x1874258609318656:12345-0@lo:101: 00010000:00010000:1.0:1787432403.930184:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432403.930202:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a997c623/0xca72b3b33563e85c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e855 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432403.930231:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a997c623/0xca72b3b33563e85c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e855 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432403.930241:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a997c623/0xca72b3b33563e85c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e855 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432403.930264:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a997c623, rc 0) 00000100:00100000:1.0:1787432403.930344:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b1fe765 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:6511:x1874258609318656:12345-0@lo:101: Request processed in 196us (5718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432403.930361:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787432403.930464:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609318656:0@lo:101: 00010000:00010000:0.0:1787432403.930482:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 00000000a1cb10b0/0xca72b3b33563e855 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e85c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432403.930491:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 00000000a1cb10b0/0xca72b3b33563e855 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e85c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432403.930569:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609318784:0@lo:501: 00000100:00100000:0.0:1787432403.930617:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432403.935532:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f4d75f9d going to sleep for 11 seconds 00000100:00100000:3.0:1787432403.938596:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609318784 00000100:00100000:3.0:1787432403.938610:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609318784 00000100:00100000:3.0:1787432403.938681:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787432403.938691:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a9077bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:6511:x1874258609318784:12345-0@lo:501: 00000100:00100000:3.0:1787432403.939523:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a9077bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:6511:x1874258609318784:12345-0@lo:501: Request processed in 832us (8916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432403.939534:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787432403.940774:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609318784:0@lo:501: 00000100:00100000:0.0:1787432403.941396:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609318912:0@lo:503: 00000100:00100000:0.0:1787432403.941486:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432403.941535:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f4d75f9d going to sleep for 11 seconds 00000100:00100000:1.0:1787432403.941548:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609318912 00000100:00100000:1.0:1787432403.941556:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609318912 00000100:00100000:1.0:1787432403.941617:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787432403.941626:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003edb9a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:6511:x1874258609318912:12345-0@lo:503: 00000100:00100000:1.0:1787432403.941933:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003edb9a6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:6511:x1874258609318912:12345-0@lo:503: Request processed in 309us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432403.941942:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787432403.942101:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609318912:0@lo:503: 00000100:00100000:0.0:1787432403.942896:0:7819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:7819:1874258609319040:0@lo:502: 00000100:00100000:0.0:1787432403.942953:0:7819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432403.942992:0:7819:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b0d9f07 going to sleep for 11 seconds 00000100:00100000:3.0:1787432403.943113:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609319040 00000100:00100000:3.0:1787432403.943119:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609319040 00000100:00100000:3.0:1787432403.943161:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787432403.943207:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdea7419 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:7819:x1874258609319040:12345-0@lo:502: 00000100:00100000:3.0:1787432403.943311:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdea7419 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:7819:x1874258609319040:12345-0@lo:502: Request processed in 105us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432403.943324:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787432403.943574:0:7819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:7819:1874258609319040:0@lo:502: 00000100:00100000:0.0:1787432403.943630:0:7819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:7819:1874258609319168:0@lo:502: 00000100:00100000:0.0:1787432403.943791:0:7819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432403.943820:0:7819:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b0d9f07 going to sleep for 11 seconds 00000100:00100000:3.0:1787432403.943967:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609319168 00000100:00100000:3.0:1787432403.943972:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609319168 00000100:00100000:3.0:1787432403.944000:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787432403.944006:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000670332ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:7819:x1874258609319168:12345-0@lo:502: 00000100:00100000:3.0:1787432403.944084:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000670332ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:7819:x1874258609319168:12345-0@lo:502: Request processed in 78us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432403.944091:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787432403.944263:0:7819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:7819:1874258609319168:0@lo:502: 00000040:00080000:0.0:1787432403.944281:0:7819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787432403.944443:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787432403.944463:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787432403.944472:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 00000000a1cb10b0/0xca72b3b33563e855 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e85c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432403.944482:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: 00000000a1cb10b0/0xca72b3b33563e855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e85c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432403.944492:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787432403.944494:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948411b1c000 from 4 10000000:01000000:2.0:1787432403.944497:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787432403.944521:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 0000000048c90c23/0xca72b3b33563e863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432403.944538:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 0000000048c90c23/0xca72b3b33563e863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432403.944547:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 0000000048c90c23/0xca72b3b33563e863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432403.944559:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000081a53163 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609319296:0@lo:101: 00000100:00100000:2.0:1787432403.944586:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432403.944619:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058d23652 going to sleep for 11 seconds 00000100:00100000:3.0:1787432403.944809:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609319296 00000100:00100000:3.0:1787432403.944813:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609319296 00000100:00100000:3.0:1787432403.944966:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787432403.944973:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8f9e859 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:6511:x1874258609319296:12345-0@lo:101: 00010000:00010000:3.0:1787432403.944981:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432403.944992:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000090b8c0e4/0xca72b3b33563e86a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e863 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432403.945011:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000090b8c0e4/0xca72b3b33563e86a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e863 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432403.945020:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000090b8c0e4/0xca72b3b33563e86a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e863 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432403.945028:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000090b8c0e4, rc 0) 00000100:00100000:3.0:1787432403.945064:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8f9e859 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609319296:12345-0@lo:101: Request processed in 93us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432403.945070:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787432403.945513:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000081a53163 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609319296:0@lo:101: 00010000:00010000:0.0:1787432403.945526:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 0000000048c90c23/0xca72b3b33563e863 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e86a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432403.945534:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 0000000048c90c23/0xca72b3b33563e863 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e86a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432403.945581:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609319424:0@lo:256: 00000100:00100000:0.0:1787432403.945777:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432403.945801:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b0d9f07 going to sleep for 11 seconds 00000100:00100000:1.0:1787432403.945910:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609319424 00000100:00100000:1.0:1787432403.945916:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609319424 00000100:00100000:1.0:1787432403.945951:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787432403.945956:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa144641 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609319424:12345-0@lo:256: 20000000:01000000:1.0:1787432403.945970:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787432403.945983:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787432403.945986:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787432403.946052:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa144641 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609319424:12345-0@lo:256: Request processed in 96us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432403.946059:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787432403.946236:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609319424:0@lo:256: 10000000:01000000:0.0:1787432403.946271:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787432403.946276:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 0000000048c90c23/0xca72b3b33563e863 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e86a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432403.946283:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: 0000000048c90c23/0xca72b3b33563e863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e86a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432403.946299:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787432403.946301:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787432403.946303:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787432403.946319:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 00000000d1306a1c/0xca72b3b33563e871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432403.946326:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 00000000d1306a1c/0xca72b3b33563e871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432403.946332:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 00000000d1306a1c/0xca72b3b33563e871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432403.946342:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609319552:0@lo:101: 00000100:00100000:0.0:1787432403.946479:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432403.946501:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b0d9f07 going to sleep for 11 seconds 00000100:00100000:1.0:1787432403.946597:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609319552 00000100:00100000:1.0:1787432403.946601:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609319552 00000100:00100000:1.0:1787432403.947127:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787432403.947134:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbcad16f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609319552:12345-0@lo:101: 00010000:00010000:1.0:1787432403.947145:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432403.947198:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e2835d0/0xca72b3b33563e878 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e871 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432403.947218:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e2835d0/0xca72b3b33563e878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e871 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432403.947226:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e2835d0/0xca72b3b33563e878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e871 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432403.947233:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e2835d0, rc 0) 00000100:00100000:1.0:1787432403.947271:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbcad16f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609319552:12345-0@lo:101: Request processed in 138us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432403.947277:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787432403.947891:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609319552:0@lo:101: 00010000:00010000:0.0:1787432403.947910:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 00000000d1306a1c/0xca72b3b33563e871 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e878 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432403.947918:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 00000000d1306a1c/0xca72b3b33563e871 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e878 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432403.947983:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609319680:0@lo:501: 00000100:00100000:0.0:1787432403.948029:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432403.948056:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b0d9f07 going to sleep for 11 seconds 00000100:00100000:1.0:1787432403.948972:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609319680 00000100:00100000:1.0:1787432403.948982:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609319680 00000100:00100000:1.0:1787432403.949036:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787432403.949045:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064b97936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609319680:12345-0@lo:501: 00000100:00100000:1.0:1787432403.949228:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064b97936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609319680:12345-0@lo:501: Request processed in 184us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432403.949235:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787432403.949379:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609319680:0@lo:501: 00000100:00100000:0.0:1787432403.949425:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609319808:0@lo:503: 00000100:00100000:0.0:1787432403.949473:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432403.949496:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b0d9f07 going to sleep for 11 seconds 00000100:00100000:2.0:1787432403.949604:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609319808 00000100:00100000:2.0:1787432403.949609:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609319808 00000100:00100000:2.0:1787432403.949632:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787432403.949649:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c54aad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609319808:12345-0@lo:503: 00000100:00100000:2.0:1787432403.949732:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c54aad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609319808:12345-0@lo:503: Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432403.949739:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787432403.950110:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609319808:0@lo:503: 00000100:00100000:0.0:1787432403.951115:0:7820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:7820:1874258609319936:0@lo:502: 00000100:00100000:0.0:1787432403.951331:0:7820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432403.951464:0:7820:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b6227af going to sleep for 11 seconds 00000100:00100000:2.0:1787432403.951536:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609319936 00000100:00100000:2.0:1787432403.951542:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609319936 00000100:00100000:2.0:1787432403.951583:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787432403.951591:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005fbee9bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:7820:x1874258609319936:12345-0@lo:502: 00000100:00100000:3.0:1787432403.951927:0:7820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032ad1080 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:7820:1874258609319936:0@lo:502: 00000020:01000000:3.0:1787432403.951964:0:7820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432403.951975:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432403.951977:0:7820:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1787432403.951983:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787432403.951986:0:7820:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.124@tcp to nid 0x20000c0a8cc7c (192.168.204.124@tcp) 00000020:00000080:3.0:1787432403.952009:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787432403.952023:0:7820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000dffe6ed1) 00000020:00000080:3.0:1787432403.952043:0:7820:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1787432403.952048:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787432403.952133:0:7820:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1787432403.952138:0:7820:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787432403.952151:0:7820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33563e886 00010000:00080000:3.0:1787432403.952296:0:7820:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d968a642@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.124@tcp at head 00000100:00100000:2.0:1787432403.952452:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005fbee9bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:7820:x1874258609319936:12345-0@lo:502: Request processed in 239us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432403.952461:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:3.0:1787432403.959310:0:7820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1787432403.962736:0:7820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787432403.962752:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787432403.962787:0:7820:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787432403.962811:0:7820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b33563e88d 00000100:00080000:1.0:1787432403.962821:0:7820:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787432403.963022:0:7820:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000d968a642 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432403.963062:0:7820:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b02277be x1874258609320064/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787432403.963093:0:7820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1787432403.963222:0:7820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:01000000:1.0:1787432403.963423:0:7820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432403.963428:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432403.963431:0:7820:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787432403.963434:0:7820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432403.963438:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432403.963439:0:7820:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787432403.963442:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787432403.963444:0:7820:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787432403.963476:0:7820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061ef4ad7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:7820:1874258609320192:0@lo:502: 00000100:00100000:1.0:1787432403.963561:0:7820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432403.963595:0:7820:0:(client.c:2715:ptlrpc_set_wait()) set 000000007f4d7ca1 going to sleep for 11 seconds 00000100:00080000:1.0:1787432403.963679:0:7823:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000002512e249 x1874258609320320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432403.963688:0:7823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d89d4df2 going to sleep for 0 seconds 00000100:00100000:3.0:1787432403.965152:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b02277be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609320064:0@lo:38: 00000100:00100000:3.0:1787432403.965264:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432403.965334:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609320192 00000100:00100000:3.0:1787432403.965341:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609320192 00000100:00100000:3.0:1787432403.965412:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787432403.965422:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6728c75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:7820:x1874258609320192:12345-0@lo:502: 00000100:00100000:3.0:1787432403.965563:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6728c75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:7820:x1874258609320192:12345-0@lo:502: Request processed in 142us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432403.965572:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787432403.965937:0:7820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061ef4ad7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:7820:1874258609320192:0@lo:502: 00000020:01000000:3.0:1787432403.965970:0:7820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432403.965976:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432403.965978:0:7820:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787432403.965982:0:7820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1787432403.966041:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787432403.966063:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787432403.966071:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 00000000d1306a1c/0xca72b3b33563e871 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e878 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432403.966081:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: 00000000d1306a1c/0xca72b3b33563e871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e878 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432403.966091:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787432403.966093:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9484336199b8 from 1 10000000:01000000:3.0:1787432403.966096:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787432403.966123:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 000000002d7d30a4/0xca72b3b33563e894 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432403.966130:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 000000002d7d30a4/0xca72b3b33563e894 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432403.966137:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 000000002d7d30a4/0xca72b3b33563e894 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432403.966151:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ce6aa0fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609320448:0@lo:101: 00000100:00100000:3.0:1787432403.966211:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432403.966237:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 0000000048911fa8 going to sleep for 11 seconds 00000100:00100000:2.0:1787432403.966467:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609320064 00000100:00100000:2.0:1787432403.966473:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609320064 00000100:00100000:2.0:1787432403.966504:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787432403.966509:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000803f4a38 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874258609320064:12345-0@lo:38: 00010000:00080000:2.0:1787432403.966545:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:2.0:1787432403.966577:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b33563e89b 00000004:00100000:2.0:1787432403.966591:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787432403.966595:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1787432403.966928:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609320448 00000100:00100000:3.0:1787432403.966934:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609320448 00000100:00100000:3.0:1787432403.966973:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787432403.966980:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd6c46b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609320448:12345-0@lo:101: 00010000:00010000:3.0:1787432403.966990:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432403.967004:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b0720b7a/0xca72b3b33563e8a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e894 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432403.967037:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b0720b7a/0xca72b3b33563e8a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e894 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432403.967046:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b0720b7a/0xca72b3b33563e8a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e894 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432403.967054:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b0720b7a, rc 0) 00000100:00100000:3.0:1787432403.967098:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd6c46b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609320448:12345-0@lo:101: Request processed in 119us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432403.967104:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787432403.967145:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ce6aa0fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609320448:0@lo:101: 00010000:00010000:3.0:1787432403.967157:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 000000002d7d30a4/0xca72b3b33563e894 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e8a2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432403.967191:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 000000002d7d30a4/0xca72b3b33563e894 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e8a2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432403.967242:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ce6aa0fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609320576:0@lo:501: 00000100:00100000:3.0:1787432403.967269:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432403.967292:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019ca19cc going to sleep for 11 seconds 00000100:00100000:3.0:1787432403.967308:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609320576 00000100:00100000:3.0:1787432403.967311:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609320576 00000100:00100000:3.0:1787432403.967331:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787432403.967337:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7c8d3ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609320576:12345-0@lo:501: 00000100:00100000:3.0:1787432403.967419:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7c8d3ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609320576:12345-0@lo:501: Request processed in 82us (149us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787432403.967425:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787432403.967463:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ce6aa0fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609320576:0@lo:501: 10000000:01000000:3.0:1787432403.967484:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787432403.967489:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: 000000002d7d30a4/0xca72b3b33563e894 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e8a2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432403.967496:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: 000000002d7d30a4/0xca72b3b33563e894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e8a2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432403.976389:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432403.976425:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000076e5ffca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609320960:0@lo:400: 00000100:00100000:0.0:1787432403.976497:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432403.976556:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609320960 00000100:00100000:0.0:1787432403.976563:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609320960 00000100:00100000:0.0:1787432403.976614:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432403.976622:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032ad1080 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609320960:12345-0@lo:400: 00000100:00100000:0.0:1787432403.976698:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032ad1080 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609320960:12345-0@lo:400: Request processed in 76us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432403.976705:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787432403.976745:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000076e5ffca x1874258609320960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432403.976758:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000076e5ffca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609320960:0@lo:400: 00000100:00100000:1.0:1787432403.977496:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ebbd5d25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609320832:0@lo:400: 00000100:00100000:1.0:1787432403.977545:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432403.977574:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432403.977580:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000601673fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609320704:0@lo:400: 00000100:00100000:1.0:1787432403.977616:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432403.977764:0:6519:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1787432403.977773:0:6519:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1787432403.979813:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609320704 00000100:00100000:0.0:1787432403.979839:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609320704 00000100:00100000:0.0:1787432403.979899:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787432403.979908:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e09ec2f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609320704:12345-0@lo:400: 00000100:00100000:0.0:1787432403.980000:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e09ec2f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609320704:12345-0@lo:400: Request processed in 92us (2383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432403.980007:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787432403.980701:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000601673fb x1874258609320704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432403.980718:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000601673fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609320704:0@lo:400: 00000100:00100000:1.0:1787432403.981063:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609320832 00000100:00100000:1.0:1787432403.981070:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609320832 00000100:00100000:3.0:1787432403.981269:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787432403.981278:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088e0a0ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609320832:12345-0@lo:400: 00000100:00100000:3.0:1787432403.981345:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088e0a0ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609320832:12345-0@lo:400: Request processed in 69us (3801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432403.981365:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787432403.981628:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ebbd5d25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609320832:0@lo:400: 00000100:00080000:2.0:1787432403.984366:0:6518:0:(import.c:65:import_set_state_nolock()) 000000000040ab20 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432403.984473:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000803f4a38 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1874258609320064:12345-0@lo:38: Request processed in 17961us (19208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432403.984484:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787432403.984846:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787432403.984856:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787432403.984864:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787432403.984870:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787432403.984873:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000d968a642 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787432403.984893:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000d89d4df2): req@000000002512e249 x1874258609320320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432403.984917:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b02277be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609320064:0@lo:38: 00000100:00100000:1.0:1787432403.985050:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432403.985090:0:7823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d89d4df2 going to sleep for 11 seconds 00000100:00100000:3.0:1787432403.985136:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609320320 00000100:00100000:3.0:1787432403.985143:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609320320 00000100:00100000:3.0:1787432403.985211:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787432403.985220:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098980626 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7823:x1874258609320320:12345-0@lo:1000: 00000100:00100000:3.0:1787432403.985304:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098980626 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7823:x1874258609320320:12345-0@lo:1000: Request processed in 86us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432403.985323:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787432403.986493:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000076e5ffca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609321088:0@lo:41: 00000100:00100000:3.0:1787432403.986544:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432403.986768:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609321088 00000100:00100000:0.0:1787432403.986776:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609321088 00000100:00100000:0.0:1787432403.986822:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787432403.986840:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce6aa0fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874258609321088:12345-0@lo:41: 00000004:00000024:0.0:1787432403.986870:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787432403.986929:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce6aa0fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874258609321088:12345-0@lo:41: Request processed in 91us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432403.986935:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787432403.987027:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000076e5ffca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609321088:0@lo:41: 00000100:00100000:2.0:1787432403.987596:0:7823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002512e249 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1874258609320320:0@lo:1000: 00000040:01000000:2.0:1787432403.987661:0:7823:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787432403.987706:0:7823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064a8c41f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1874258609321216:0@lo:1000: 00000100:00100000:2.0:1787432403.987745:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432403.987770:0:7823:0:(client.c:2715:ptlrpc_set_wait()) set 0000000066275862 going to sleep for 11 seconds 00000100:00100000:0.0:1787432403.987870:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609321216 00000100:00100000:0.0:1787432403.987876:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609321216 00000100:00100000:0.0:1787432403.987910:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787432403.987917:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047d6d07e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7823:x1874258609321216:12345-0@lo:1000: 00000100:00100000:0.0:1787432403.988032:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047d6d07e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7823:x1874258609321216:12345-0@lo:1000: Request processed in 115us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432403.988039:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432403.988676:0:7823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064a8c41f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1874258609321216:0@lo:1000: 00000100:00100000:2.0:1787432403.988724:0:7823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064a8c41f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1874258609321344:0@lo:700: 00000100:00100000:2.0:1787432403.988757:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432403.988780:0:7823:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058d23652 going to sleep for 11 seconds 00000100:00100000:0.0:1787432403.989146:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609321344 00000100:00100000:0.0:1787432403.989152:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609321344 00000100:00100000:0.0:1787432403.989218:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432403.989225:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e1fd96d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7823:x1874258609321344:12345-0@lo:700: 00000100:00100000:0.0:1787432403.989286:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e1fd96d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7823:x1874258609321344:12345-0@lo:700: Request processed in 62us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432403.989294:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432403.989649:0:7823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064a8c41f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1874258609321344:0@lo:700: 00000100:00100000:2.0:1787432403.989854:0:7823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064a8c41f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1874258609321472:0@lo:1000: 00000100:00100000:2.0:1787432403.989889:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432403.989922:0:7823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d95cb56b going to sleep for 11 seconds 00000100:00100000:0.0:1787432403.990326:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609321472 00000100:00100000:0.0:1787432403.990332:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609321472 00000100:00100000:0.0:1787432403.990377:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787432403.990385:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020320ec8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7823:x1874258609321472:12345-0@lo:1000: 00000100:00100000:0.0:1787432403.990465:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020320ec8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7823:x1874258609321472:12345-0@lo:1000: Request processed in 82us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432403.990481:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787432403.990840:0:7823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064a8c41f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1874258609321472:0@lo:1000: 00000004:00080000:2.0:1787432403.990893:0:7823:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000058d23652 with version 0 00000020:00100000:2.0:1787432403.990910:0:7823:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787432403.990916:0:7823:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000064a8c41f x1874258609321728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787432403.990930:0:7823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064a8c41f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1874258609321728:0@lo:1000: 00000100:00100000:2.0:1787432403.990961:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432403.990987:0:7823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f2f9f529 going to sleep for 11 seconds 00000100:00100000:3.0:1787432403.991034:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609321728 00000100:00100000:3.0:1787432403.991039:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609321728 00000100:00100000:3.0:1787432403.991064:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787432403.991071:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081a53163 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7823:x1874258609321728:12345-0@lo:1000: 00000001:00080000:2.0:1787432404.008075:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1787432404.008091:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787432404.013519:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081a53163 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7823:x1874258609321728:12345-0@lo:1000: Request processed in 22439us (22549us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787432404.013535:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1787432404.013865:0:7823:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1787432404.013870:0:7823:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787432404.013888:0:7823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064a8c41f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1874258609321728:0@lo:1000: 00000100:00100000:2.0:1787432404.014059:0:7823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064a8c41f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1874258609321856:0@lo:1000: 00000100:00100000:2.0:1787432404.014806:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432404.014916:0:7823:0:(client.c:2715:ptlrpc_set_wait()) set 0000000066275862 going to sleep for 11 seconds 00000100:00100000:1.0:1787432404.015080:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609321856 00000100:00100000:1.0:1787432404.015089:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609321856 00000100:00100000:1.0:1787432404.015503:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787432404.015525:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ecab9a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7823:x1874258609321856:12345-0@lo:1000: 00000100:00100000:1.0:1787432404.015643:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ecab9a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7823:x1874258609321856:12345-0@lo:1000: Request processed in 110us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432404.015651:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787432404.015720:0:7823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064a8c41f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1874258609321856:0@lo:1000: 00000040:00080000:2.0:1787432404.015742:0:7823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1787432404.015778:0:7823:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000058d23652 with version 1 00000040:00080000:2.0:1787432404.017881:0:7823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787432404.017967:0:7823:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1787432404.017972:0:7823:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:3.0:1787432404.018936:0:7821:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000923d2877 version 1 rpc_version 1 00000020:00100000:3.0:1787432404.018994:0:7821:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787432404.019005:0:7821:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000005665c102 x1874258609322112/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432404.019028:0:7821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005665c102 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7821:1874258609322112:0@lo:1000: 00000100:00100000:3.0:1787432404.019106:0:7821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432404.019965:0:7821:0:(client.c:2715:ptlrpc_set_wait()) set 000000000942b432 going to sleep for 11 seconds 00000100:00100000:0.0:1787432404.020126:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609322112 00000100:00100000:0.0:1787432404.020136:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609322112 00000100:00100000:0.0:1787432404.020205:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787432404.020214:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000710f3db5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7821:x1874258609322112:12345-0@lo:1000: 00000001:00080000:3.0:1787432404.037825:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1787432404.038209:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000710f3db5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7821:x1874258609322112:12345-0@lo:1000: Request processed in 17992us (19109us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787432404.038223:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:3.0:1787432404.038325:0:7821:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1787432404.038330:0:7821:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787432404.038347:0:7821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005665c102 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7821:1874258609322112:0@lo:1000: 00010000:00010000:0.0:1787432404.171488:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432405.209836:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787432405.516922:0:7874:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432405.517306:0:7874:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787432406.219958:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787432406.864086:0:7922:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda33ebe20 20000000:00000080:0.0:1787432406.864107:0:7922:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff948441189000 uarg=0000000000000000 20000000:01000000:0.0:1787432406.864154:0:7922:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787432406.864161:0:7922:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787432406.864211:0:7922:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787432406.864300:0:7922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787432406.864312:0:7922:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787432406.875993:0:7922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432406.877112:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787432406.877191:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787432406.877215:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787432406.877238:0:7922:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787432406.877256:0:7922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d475fef6/0xca72b3b33563e8a9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432406.877276:0:7922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008e45a85b/0xca72b3b33563e728 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e721 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432406.877284:0:7922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d21990e0/0xca72b3b33563e816 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e80f expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432406.877301:0:7922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d475fef6/0xca72b3b33563e8a9 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432406.877362:0:7922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d21990e0/0xca72b3b33563e816 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e80f expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432406.877376:0:7922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d21990e0/0xca72b3b33563e816 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e80f expref: 17 pid: 6506 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432406.877392:0:7922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033b466ad pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1874258609322240:0@lo:104: 00000100:00100000:0.0:1787432406.877466:0:7922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432406.877540:0:7922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008e45a85b/0xca72b3b33563e728 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e721 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432406.877549:0:7922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008e45a85b/0xca72b3b33563e728 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e721 expref: 17 pid: 6506 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432406.877557:0:7922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f710c387 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1874258609322368:0@lo:104: 00000100:00100000:0.0:1787432406.877595:0:7922:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b31aeca3 going to sleep for 11 seconds 00000100:00100000:3.0:1787432406.878286:0:7455:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787432406.878316:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432406.878358:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609322240 00000100:00100000:3.0:1787432406.878378:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609322240 00000100:00100000:3.0:1787432406.878429:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609322368 00000100:00100000:3.0:1787432406.878433:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609322368 00000100:00100000:3.0:1787432406.878448:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787432406.878457:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000112a092b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:7922:x1874258609322240:12345-0@lo:104: 00010000:00010000:3.0:1787432406.878469:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: 00000000eda33c0a/0xca72b3b33563e80f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e816 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.878528:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787432406.878533:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000112a092b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:7922:x1874258609322240:12345-0@lo:104: Request processed in 78us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432406.878541:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787432406.878578:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432406.878584:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005665c102 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:7922:x1874258609322368:12345-0@lo:104: 00010000:00010000:3.0:1787432406.878592:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: 00000000748c912f/0xca72b3b33563e721 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e728 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.878626:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787432406.878631:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005665c102 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:7922:x1874258609322368:12345-0@lo:104: Request processed in 48us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432406.878636:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1787432406.878652:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787432406.878657:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: 00000000eda33c0a/0xca72b3b33563e80f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e816 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.878663:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eda33c0a already unused, calling callback (000000002e80036b) 10000000:00010000:3.0:1787432406.878680:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: 00000000eda33c0a/0xca72b3b33563e80f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e816 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.878698:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: 00000000eda33c0a/0xca72b3b33563e80f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e816 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432406.878704:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: 00000000eda33c0a/0xca72b3b33563e80f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e816 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432406.878709:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787432406.878739:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: 00000000eda33c0a/0xca72b3b33563e80f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e816 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.878746:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787432406.878763:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: 00000000eda33c0a/0xca72b3b33563e80f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e816 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.878770:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: 00000000eda33c0a/0xca72b3b33563e80f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e816 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.878787:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432406.878790:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: 00000000748c912f/0xca72b3b33563e721 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e728 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.878795:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000748c912f already unused, calling callback (000000002e80036b) 10000000:00010000:3.0:1787432406.878797:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: 00000000748c912f/0xca72b3b33563e721 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e728 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.878803:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: 00000000748c912f/0xca72b3b33563e721 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e728 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432406.878809:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: 00000000748c912f/0xca72b3b33563e721 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e728 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432406.878821:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787432406.878835:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: 00000000748c912f/0xca72b3b33563e721 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e728 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.878840:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787432406.878845:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: 00000000748c912f/0xca72b3b33563e721 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e728 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.878849:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: 00000000748c912f/0xca72b3b33563e721 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e728 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.878863:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432406.878864:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432406.878865:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432406.878910:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086acdcd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609322496:0@lo:103: 00000100:00100000:3.0:1787432406.878940:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432406.878968:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432406.878973:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c63ad90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609322624:0@lo:103: 00000100:00100000:3.0:1787432406.878990:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787432406.879006:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432406.879016:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609322496 00000100:00100000:3.0:1787432406.879020:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609322496 00010000:00010000:3.0:1787432406.879035:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d21990e0/0xca72b3b33563e816 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e80f expref: 18 pid: 6506 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432406.879053:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609322624 00000100:00100000:3.0:1787432406.879056:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609322624 00010000:00010000:3.0:1787432406.879064:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008e45a85b/0xca72b3b33563e728 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e721 expref: 19 pid: 6506 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432406.879090:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787432406.879095:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055fab94a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:3641:x1874258609322496:12345-0@lo:103: 00010000:00010000:3.0:1787432406.879105:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432406.879110:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d21990e0/0xca72b3b33563e816 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e80f expref: 19 pid: 6506 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.879119:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d21990e0/0xca72b3b33563e816 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e80f expref: 19 pid: 6506 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.879135:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432406.879198:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055fab94a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:3641:x1874258609322496:12345-0@lo:103: Request processed in 67us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432406.879205:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787432406.879219:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432406.879225:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009591688b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:3641:x1874258609322624:12345-0@lo:103: 00010000:00010000:3.0:1787432406.879232:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432406.879235:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008e45a85b/0xca72b3b33563e728 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e721 expref: 18 pid: 6506 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.879242:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008e45a85b/0xca72b3b33563e728 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e721 expref: 18 pid: 6506 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.879252:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d475fef6/0xca72b3b33563e8a9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.879259:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d475fef6/0xca72b3b33563e8a9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.879280:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d475fef6/0xca72b3b33563e8a9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.879286:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d475fef6/0xca72b3b33563e8a9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.879291:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d475fef6/0xca72b3b33563e8a9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.879296:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d475fef6/0xca72b3b33563e8a9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.879301:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d475fef6 already unused, calling callback (0000000033074501) 00010000:00010000:3.0:1787432406.879304:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d475fef6/0xca72b3b33563e8a9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.879310:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d475fef6/0xca72b3b33563e8a9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.879316:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d475fef6/0xca72b3b33563e8a9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432406.879324:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432406.879359:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009591688b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:3641:x1874258609322624:12345-0@lo:103: Request processed in 135us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432406.879365:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432406.879403:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c63ad90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609322624:0@lo:103: 00000100:00100000:3.0:1787432406.879412:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086acdcd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609322496:0@lo:103: 00010000:00010000:0.0:1787432406.882116:0:7922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d21990e0/0xca72b3b33563e816 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e80f expref: 17 pid: 6506 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432406.882141:0:7922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033b466ad pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1874258609322240:0@lo:104: 00010000:00010000:0.0:1787432406.882154:0:7922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008e45a85b/0xca72b3b33563e728 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e721 expref: 16 pid: 6506 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432406.882182:0:7922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f710c387 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1874258609322368:0@lo:104: 00010000:00010000:0.0:1787432406.882212:0:7922:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d475fef6/0xca72b3b33563e8a9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432406.882241:0:7922:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d475fef6/0xca72b3b33563e8a9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432406.882248:0:7922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d475fef6/0xca72b3b33563e8a9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432406.882253:0:7922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d475fef6/0xca72b3b33563e8a9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432406.998633:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432406.998656:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064a8c41f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609322752:0@lo:41: 00000100:00100000:2.0:1787432406.998747:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432406.999836:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609322752 00000100:00100000:1.0:1787432406.999850:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609322752 00000100:00100000:1.0:1787432406.999927:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787432406.999937:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e73a445 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609322752:12345-0@lo:41: 00000004:00000024:1.0:1787432406.999978:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1787432407.000056:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e73a445 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609322752:12345-0@lo:41: Request processed in 121us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432407.000064:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787432407.001220:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064a8c41f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609322752:0@lo:41: 00010000:00010000:3.0:1787432407.243525:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432408.269894:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432409.037902:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f710c387 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609322880:0@lo:41: 00000100:00100000:0.0:1787432409.037981:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432409.038058:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609322880 00000100:00100000:0.0:1787432409.038066:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609322880 00000100:00100000:0.0:1787432409.038111:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787432409.038120:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033b466ad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609322880:12345-0@lo:41: 00000004:00000024:0.0:1787432409.038160:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787432409.038222:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033b466ad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609322880:12345-0@lo:41: Request processed in 104us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432409.038229:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787432409.038255:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c8d0704 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609323264:0@lo:400: 00000100:00100000:0.0:1787432409.038281:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432409.038319:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432409.038325:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd6b1829 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609323392:0@lo:400: 00000100:00100000:0.0:1787432409.038352:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432409.038374:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609323264 00000100:00100000:0.0:1787432409.038377:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609323392 00000100:00100000:2.0:1787432409.038379:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609323264 00000100:00100000:0.0:1787432409.038379:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609323392 00000100:00100000:2.0:1787432409.038404:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787432409.038404:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787432409.038409:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdff4cd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609323264:12345-0@lo:400: 00000100:00100000:0.0:1787432409.038423:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f096581f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609323392:12345-0@lo:400: 00000100:00100000:2.0:1787432409.038448:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdff4cd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609323264:12345-0@lo:400: Request processed in 39us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432409.038448:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f096581f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609323392:12345-0@lo:400: Request processed in 26us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432409.038455:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787432409.038455:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787432409.038496:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000cd6b1829 x1874258609323392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432409.038509:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd6b1829 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609323392:0@lo:400: 00000100:00100000:0.0:1787432409.038520:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c8d0704 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609323264:0@lo:400: 00000100:00100000:0.0:1787432409.038564:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f710c387 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609322880:0@lo:41: 00000100:00100000:0.0:1787432409.038595:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064a8c41f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609323008:0@lo:400: 00000100:00100000:0.0:1787432409.038625:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432409.038664:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432409.038670:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f79a0fee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609323136:0@lo:400: 00000100:00100000:0.0:1787432409.038691:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432409.038841:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609323136 00000100:00100000:3.0:1787432409.038845:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609323136 00000100:00100000:3.0:1787432409.038874:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787432409.038881:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f710c387 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609323136:12345-0@lo:400: 00000100:00100000:3.0:1787432409.039151:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f710c387 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609323136:12345-0@lo:400: Request processed in 270us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432409.039160:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787432409.039217:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f79a0fee x1874258609323136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432409.039228:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f79a0fee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609323136:0@lo:400: 00000100:00100000:2.0:1787432409.041128:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609323008 00000100:00100000:2.0:1787432409.041140:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609323008 00000100:00100000:2.0:1787432409.041314:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787432409.042096:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cb13c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:3641:x1874258609323008:12345-0@lo:400: 00000100:00100000:2.0:1787432409.043021:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cb13c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:3641:x1874258609323008:12345-0@lo:400: Request processed in 1695us (4391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432409.043034:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787432409.053426:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064a8c41f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609323008:0@lo:400: 00010000:00010000:0.0:1787432409.293481:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432410.316778:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787432410.316851:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787432410.316855:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94842dfc5000 from 1 10000000:01000000:2.0:1787432410.316861:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787432410.316907:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e8b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432410.316919:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e8b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432410.316929:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e8b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432410.316952:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d5ef3e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609323520:0@lo:101: 00000100:00100000:2.0:1787432410.317048:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432410.317096:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f5d1de6e going to sleep for 11 seconds 00000100:00100000:3.0:1787432410.317245:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609323520 00000100:00100000:3.0:1787432410.317253:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609323520 00000100:00100000:3.0:1787432410.317310:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787432410.317320:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed2910f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609323520:12345-0@lo:101: 00010000:00010000:3.0:1787432410.317336:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432410.317363:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000470d3cc7/0xca72b3b33563e8b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e8b0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432410.317390:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000470d3cc7/0xca72b3b33563e8b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e8b0 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432410.317399:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000470d3cc7/0xca72b3b33563e8b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e8b0 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432410.317408:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000470d3cc7, rc 0) 00000100:00100000:3.0:1787432410.317452:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed2910f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609323520:12345-0@lo:101: Request processed in 134us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432410.317466:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787432410.317633:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d5ef3e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609323520:0@lo:101: 00010000:00010000:3.0:1787432410.317648:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e8b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432410.317656:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: 00000000cc1a3282/0xca72b3b33563e8b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432410.317713:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086acdcd4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609323648:0@lo:501: 00000100:00100000:3.0:1787432410.317743:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432410.317759:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000833f00f2 going to sleep for 11 seconds 00000100:00100000:3.0:1787432410.317773:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609323648 00000100:00100000:3.0:1787432410.317777:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609323648 00000100:00100000:3.0:1787432410.317801:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787432410.317807:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b76fc81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609323648:12345-0@lo:501: 00000100:00100000:3.0:1787432410.317920:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b76fc81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609323648:12345-0@lo:501: Request processed in 113us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432410.317928:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787432410.317957:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086acdcd4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609323648:0@lo:501: 00000100:00100000:3.0:1787432410.317985:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086acdcd4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609323776:0@lo:503: 00000100:00100000:3.0:1787432410.318024:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432410.318037:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000833f00f2 going to sleep for 11 seconds 00000100:00100000:3.0:1787432410.318049:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609323776 00000100:00100000:3.0:1787432410.318052:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609323776 00000100:00100000:3.0:1787432410.318072:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787432410.318078:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ff6f9be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609323776:12345-0@lo:503: 00000100:00100000:3.0:1787432410.319792:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ff6f9be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609323776:12345-0@lo:503: Request processed in 1711us (1765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432410.319804:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787432410.321415:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086acdcd4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609323776:0@lo:503: 00000100:00100000:1.0:1787432410.329856:0:8045:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001818bfd4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8045:1874258609323904:0@lo:502: 00000100:00100000:1.0:1787432410.329940:0:8045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432410.329992:0:8045:0:(client.c:2715:ptlrpc_set_wait()) set 000000007f4d7ca1 going to sleep for 11 seconds 00000100:00100000:2.0:1787432410.330102:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609323904 00000100:00100000:2.0:1787432410.330119:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609323904 00000100:00100000:2.0:1787432410.330198:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787432410.330207:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000664e17bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:8045:x1874258609323904:12345-0@lo:502: 00000100:00100000:2.0:1787432410.330598:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000664e17bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:8045:x1874258609323904:12345-0@lo:502: Request processed in 392us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432410.330606:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787432410.330779:0:8045:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001818bfd4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8045:1874258609323904:0@lo:502: 00000020:01000000:1.0:1787432410.330807:0:8045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432410.330816:0:8045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432410.330818:0:8045:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787432410.330825:0:8045:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94842dfc5000 00000020:00000080:1.0:1787432410.330828:0:8045:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787432410.330868:0:8045:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8045:1874258609324032:0@lo:502: 00000100:00100000:1.0:1787432410.330906:0:8045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432410.330928:0:8045:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112df6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432410.331009:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609324032 00000100:00100000:0.0:1787432410.331015:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609324032 00000100:00100000:0.0:1787432410.331041:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787432410.331048:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:8045:x1874258609324032:12345-0@lo:502: 00000100:00100000:0.0:1787432410.331130:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:8045:x1874258609324032:12345-0@lo:502: Request processed in 81us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432410.331137:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787432410.331549:0:8045:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8045:1874258609324032:0@lo:502: 00000020:01000000:1.0:1787432410.331578:0:8045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432410.331583:0:8045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432410.331585:0:8045:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787432410.331588:0:8045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787432410.331800:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787432410.331822:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787432410.331832:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563e8b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432410.331850:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563e8b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432410.331860:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787432410.331863:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948411b1c000 from 1 10000000:01000000:0.0:1787432410.331866:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787432410.331891:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948400030200/0xca72b3b33563e8be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432410.331899:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948400030200/0xca72b3b33563e8be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432410.331908:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948400030200/0xca72b3b33563e8be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432410.331922:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405941880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609324160:0@lo:101: 00000100:00100000:0.0:1787432410.331955:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432410.331998:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358d76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432410.332117:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609324160 00000100:00100000:2.0:1787432410.332123:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609324160 00000100:00100000:2.0:1787432410.332146:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787432410.332154:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609324160:12345-0@lo:101: 00010000:00010000:2.0:1787432410.332195:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432410.332208:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484032e5800/0xca72b3b33563e8c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e8be expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432410.332233:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e5800/0xca72b3b33563e8c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e8be expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432410.332494:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484032e5800/0xca72b3b33563e8c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e8be expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432410.332504:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e5800, rc 0) 00000100:00100000:2.0:1787432410.332608:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609324160:12345-0@lo:101: Request processed in 453us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432410.332615:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787432410.334539:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405941880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609324160:0@lo:101: 00010000:00010000:0.0:1787432410.334565:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948400030200/0xca72b3b33563e8be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e8c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432410.334577:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948400030200/0xca72b3b33563e8be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e8c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432410.334651:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405941880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609324288:0@lo:501: 00000100:00100000:0.0:1787432410.334698:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432410.334728:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358d76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432410.334984:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609324288 00000100:00100000:2.0:1787432410.334990:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609324288 00000100:00100000:2.0:1787432410.335044:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787432410.335053:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609324288:12345-0@lo:501: 00000100:00100000:2.0:1787432410.335415:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609324288:12345-0@lo:501: Request processed in 184us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432410.335424:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787432410.335655:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405941880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609324288:0@lo:501: 00000100:00100000:1.0:1787432410.335687:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609324416:0@lo:503: 00000100:00100000:1.0:1787432410.335724:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432410.335747:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112df6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432410.335762:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609324416 00000100:00100000:1.0:1787432410.335765:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609324416 00000100:00100000:1.0:1787432410.335787:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787432410.335793:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609324416:12345-0@lo:503: 00000100:00100000:1.0:1787432410.335865:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609324416:12345-0@lo:503: Request processed in 72us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432410.335872:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787432410.335910:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609324416:0@lo:503: 00000100:00100000:1.0:1787432410.336091:0:8046:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8046:1874258609324544:0@lo:502: 00000100:00100000:1.0:1787432410.336136:0:8046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432410.336153:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609324544 00000100:00100000:1.0:1787432410.336156:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609324544 00000100:00100000:1.0:1787432410.336189:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787432410.336195:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:8046:x1874258609324544:12345-0@lo:502: 00000100:00100000:1.0:1787432410.336655:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:8046:x1874258609324544:12345-0@lo:502: Request processed in 457us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432410.336662:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787432410.336698:0:8046:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112df540 going to sleep for 11 seconds 00000100:00100000:1.0:1787432410.336721:0:8046:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8046:1874258609324544:0@lo:502: 00000020:01000000:1.0:1787432410.336743:0:8046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432410.336753:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432410.336755:0:8046:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787432410.336761:0:8046:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948411b1c000 00000020:00000080:1.0:1787432410.336763:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787432410.336784:0:8046:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8046:1874258609324672:0@lo:502: 00000100:00100000:1.0:1787432410.336811:0:8046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432410.336832:0:8046:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112cfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432410.336897:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609324672 00000100:00100000:2.0:1787432410.336901:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609324672 00000100:00100000:2.0:1787432410.336931:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787432410.336939:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:8046:x1874258609324672:12345-0@lo:502: 00000100:00100000:2.0:1787432410.337022:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:8046:x1874258609324672:12345-0@lo:502: Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432410.337029:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787432410.338595:0:8046:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8046:1874258609324672:0@lo:502: 00000020:01000000:0.0:1787432410.338634:0:8046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432410.338641:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432410.338643:0:8046:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787432410.338646:0:8046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787432410.338839:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787432410.338863:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432410.338873:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948400030200/0xca72b3b33563e8be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e8c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432410.338884:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948400030200/0xca72b3b33563e8be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e8c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432411.339924:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432412.111963:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432412.111994:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609324800:0@lo:41: 00000100:00100000:3.0:1787432412.112076:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432412.112880:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609324800 00000100:00100000:2.0:1787432412.112890:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609324800 00000100:00100000:2.0:1787432412.112952:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787432412.112963:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609324800:12345-0@lo:41: 00000004:00000024:2.0:1787432412.113000:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1787432412.113101:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609324800:12345-0@lo:41: Request processed in 140us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432412.113109:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787432412.113232:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609324800:0@lo:41: 00010000:00010000:3.0:1787432412.363705:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432413.387596:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432414.155342:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609325056:0@lo:400: 00000100:00100000:2.0:1787432414.155415:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432414.155476:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432414.155482:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609325184:0@lo:400: 00000100:00100000:2.0:1787432414.155507:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432414.155548:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609325056 00000100:00100000:2.0:1787432414.155563:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609325056 00000100:00100000:2.0:1787432414.155607:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787432414.155615:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609325056:12345-0@lo:400: 00000100:00100000:2.0:1787432414.155660:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609325056:12345-0@lo:400: Request processed in 45us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432414.155667:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787432414.155686:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609325184 00000100:00100000:2.0:1787432414.155689:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609325184 00000100:00100000:2.0:1787432414.155709:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787432414.155714:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609325184:12345-0@lo:400: 00000100:00100000:2.0:1787432414.155739:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609325184:12345-0@lo:400: Request processed in 25us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432414.155745:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787432414.155793:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609325184:0@lo:400: 00010000:00080000:2.0:1787432414.155804:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948433652300 x1874258609325056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432414.155814:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609325056:0@lo:400: 00000100:00100000:1.0:1787432414.156139:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609324928:0@lo:400: 00000100:00100000:1.0:1787432414.156214:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432414.156238:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609325440:0@lo:400: 00000100:00100000:1.0:1787432414.156258:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432414.156276:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432414.156281:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609325312:0@lo:400: 00000100:00100000:1.0:1787432414.156298:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432414.156322:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609325440 00000100:00100000:1.0:1787432414.156325:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609325440 00000100:00100000:1.0:1787432414.156347:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787432414.156354:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609325440:12345-0@lo:400: 00000100:00100000:1.0:1787432414.156384:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609325440:12345-0@lo:400: Request processed in 30us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432414.156390:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787432414.156407:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609325312 00000100:00100000:1.0:1787432414.156409:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609325312 00000100:00100000:1.0:1787432414.156427:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787432414.156432:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609325312:12345-0@lo:400: 00000100:00100000:1.0:1787432414.156469:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609325312:12345-0@lo:400: Request processed in 37us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432414.156476:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787432414.156505:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948433653100 x1874258609325312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432414.156515:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609325312:0@lo:400: 00000100:00100000:1.0:1787432414.156524:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609325440:0@lo:400: 00000100:00100000:2.0:1787432414.156672:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609324928 00000100:00100000:2.0:1787432414.156676:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609324928 00000100:00100000:2.0:1787432414.156698:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787432414.156704:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:3642:x1874258609324928:12345-0@lo:400: 00000100:00100000:2.0:1787432414.156733:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:3642:x1874258609324928:12345-0@lo:400: Request processed in 30us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432414.156739:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787432414.156809:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609324928:0@lo:400: 00000100:00100000:1.0:1787432414.159073:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609325568:0@lo:41: 00000100:00100000:1.0:1787432414.159131:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432414.159199:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609325568 00000100:00100000:1.0:1787432414.159214:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609325568 00000100:00100000:1.0:1787432414.159257:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787432414.159266:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609325568:12345-0@lo:41: 00000004:00000024:1.0:1787432414.159300:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787432414.159340:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609325568:12345-0@lo:41: Request processed in 75us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432414.159347:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787432414.159389:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609325568:0@lo:41: 00010000:00010000:3.0:1787432414.412286:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432415.437284:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432416.463970:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432417.228274:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432417.228308:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609325696:0@lo:41: 00000100:00100000:0.0:1787432417.228472:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432417.228544:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609325696 00000100:00100000:0.0:1787432417.228552:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609325696 00000100:00100000:0.0:1787432417.228600:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787432417.228610:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609325696:12345-0@lo:41: 00000004:00000024:0.0:1787432417.228647:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1787432417.228698:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609325696:12345-0@lo:41: Request processed in 88us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432417.228706:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787432417.228760:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609325696:0@lo:41: 00010000:00010000:0.0:1787432417.489503:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432418.509272:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787432418.721145:0:8423:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787432418.721149:0:8423:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787432418.721151:0:8423:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787432418.721306:0:8423:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff948435a21000 00000020:01000004:3.0:1787432418.721322:0:8423:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787432418.721335:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787432418.724971:0:8423:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9484093b3370) 00000020:00000080:3.0:1787432418.725011:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787432418.813620:0:8423:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787432418.813683:0:8423:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1787432418.884559:0:8423:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787432418.884961:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787432418.884974:0:8423:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787432418.884988:0:8423:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xca72b3b33563e8d3 00000020:01000004:2.0:1787432418.884995:0:8423:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787432418.885017:0:8423:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.124@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787432418.885021:0:8423:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787432418.885027:0:8423:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787432418.885032:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787432418.885043:0:8423:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9484349d4d28) 00000020:00000080:2.0:1787432418.885053:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1787432418.893982:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432418.894209:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787432418.894216:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787432418.898897:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787432418.898922:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787432418.900660:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787432418.900677:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787432418.909583:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787432418.909775:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787432418.909782:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787432418.912315:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787432418.912346:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787432419.019258:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787432419.020487:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787432419.020496:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787432419.030237:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787432419.035881:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787432419.039323:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787432419.039351:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787432419.043607:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432419.043849:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787432419.043856:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787432419.047832:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787432419.047850:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787432419.203024:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787432419.210541:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787432419.210561:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787432419.220256:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787432419.220350:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787432419.221155:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787432419.221213:0:8423:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1787432419.221221:0:8423:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.124@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787432419.274276:0:8423:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.124@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787432419.274319:0:8423:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.124@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787432419.274324:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787432419.274325:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787432419.274327:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432419.274328:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432419.274328:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432419.274335:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432419.274336:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787432419.274337:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787432419.274339:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787432419.274340:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432419.274341:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787432419.274345:0:8423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787432419.274347:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787432419.274348:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787432419.274349:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432419.274349:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432419.274350:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432419.274351:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432419.274352:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787432419.274353:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787432419.274353:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787432419.274354:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432419.274355:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787432419.274382:0:8423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787432419.274401:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609325824:0@lo:253: 00000100:00100000:3.0:1787432419.274484:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432419.274535:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d67a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432419.274635:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609325824 00000100:00100000:1.0:1787432419.274644:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609325824 00000100:00100000:1.0:1787432419.274712:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787432419.274723:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:8423:x1874258609325824:12345-0@lo:253: 20000000:01000000:1.0:1787432419.274768:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787432419.274772:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787432419.274778:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787432419.274781:0:6507:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787432419.275245:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787432419.275299:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609326080:0@lo:400: 00000100:00100000:2.0:1787432419.275356:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432419.275386:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000040:00080000:1.0:1787432419.275386:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787432419.275399:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000100:00100000:2.0:1787432419.275403:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609325952:0@lo:400: 00000040:00080000:1.0:1787432419.275428:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787432419.275436:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000100:00100000:2.0:1787432419.275444:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787432419.275449:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787432419.275464:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000100:00100000:2.0:1787432419.275471:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609326336:0@lo:400: 00000100:00100000:2.0:1787432419.275506:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432419.275531:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432419.275538:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609326208:0@lo:400: 00000040:00080000:1.0:1787432419.275547:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787432419.275561:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.124@tcp 20000000:01000000:1.0:1787432419.275563:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.124@tcp (null) (null) (null) 00000100:00100000:2.0:1787432419.275571:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787432419.275576:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787432419.275588:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000100:00100000:2.0:1787432419.275603:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609326080 00000040:00080000:1.0:1787432419.275604:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 00000100:00100000:2.0:1787432419.275607:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609326080 20000000:01000000:1.0:1787432419.275610:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.124@tcp (null) (null) 00000040:00080000:1.0:1787432419.275622:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787432419.275627:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000100:00100000:2.0:1787432419.275635:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609326336 00000100:00100000:2.0:1787432419.275637:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609326336 00000040:00080000:1.0:1787432419.275639:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000100:00100000:2.0:1787432419.275653:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000040:00080000:1.0:1787432419.275653:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000100:00100000:2.0:1787432419.275660:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609326080:12345-0@lo:400: 00000040:00080000:1.0:1787432419.275720:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1787432419.275731:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.124@tcp 00000100:00100000:2.0:1787432419.275732:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609326080:12345-0@lo:400: Request processed in 72us (376us total) trans 0 rc 0/0 20000000:01000000:1.0:1787432419.275733:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.124@tcp (null) (null) (null) 00000100:00100000:2.0:1787432419.275740:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000040:00080000:1.0:1787432419.275747:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1787432419.275751:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000100:00100000:2.0:1787432419.275759:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000040:00080000:1.0:1787432419.275763:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 00000100:00100000:2.0:1787432419.275766:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609326336:12345-0@lo:400: 20000000:01000000:1.0:1787432419.275767:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.124@tcp (null) (null) 00000040:00080000:1.0:1787432419.275778:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1787432419.275784:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000100:00100000:2.0:1787432419.275798:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609326336:12345-0@lo:400: Request processed in 33us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432419.275804:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000040:00080000:1.0:1787432419.275812:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000100:00100000:2.0:1787432419.275823:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609325952 00000100:00100000:2.0:1787432419.275827:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609325952 00000040:00080000:1.0:1787432419.275829:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000100:00100000:2.0:1787432419.275849:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609326208 00000100:00100000:2.0:1787432419.275851:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609326208 00000100:00100000:2.0:1787432419.275862:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432419.275867:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609325952:12345-0@lo:400: 00000100:00100000:2.0:1787432419.275893:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609325952:12345-0@lo:400: Request processed in 26us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432419.275898:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432419.275908:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787432419.275914:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609326208:12345-0@lo:400: 00000100:00100000:2.0:1787432419.275945:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609326208:12345-0@lo:400: Request processed in 31us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432419.275950:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787432419.275993:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948433652d80 x1874258609326208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432419.276007:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609326208:0@lo:400: 00000100:00100000:2.0:1787432419.276017:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609326336:0@lo:400: 00010000:00080000:2.0:1787432419.276045:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948433652300 x1874258609325952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432419.276053:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609325952:0@lo:400: 00000100:00100000:2.0:1787432419.276063:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609326080:0@lo:400: 00000100:00100000:2.0:1787432419.276333:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432419.276341:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609326464:0@lo:41: 00000100:00100000:2.0:1787432419.276366:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787432419.276443:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 00000100:00100000:2.0:1787432419.276453:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609326464 00000100:00100000:2.0:1787432419.276457:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609326464 20000000:01000000:1.0:1787432419.276457:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.124@tcp 20000000:01000000:1.0:1787432419.276459:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.124@tcp (null) (null) (null) 00000040:00080000:1.0:1787432419.276487:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1787432419.276494:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787432419.276509:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1787432419.276514:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.124@tcp (null) (null) 00000040:00080000:1.0:1787432419.276526:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1787432419.276533:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000100:00100000:2.0:1787432419.276540:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000040:00080000:1.0:1787432419.276545:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000100:00100000:2.0:1787432419.276547:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609326464:12345-0@lo:41: 00000040:00080000:1.0:1787432419.276560:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 00000004:00000024:2.0:1787432419.276570:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 20000000:01000000:1.0:1787432419.276572:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787432419.276581:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787432419.276584:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 00000100:00100000:2.0:1787432419.276609:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609326464:12345-0@lo:41: Request processed in 63us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432419.276615:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 20000000:01000000:1.0:1787432419.276627:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787432419.276630:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 00000100:00100000:2.0:1787432419.276643:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609326464:0@lo:41: 20000000:01000000:2.0:1787432419.277619:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1787432419.277659:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1787432419.277677:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1787432419.278076:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1787432419.278097:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1787432419.278126:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1787432419.278136:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787432419.278139:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787432419.278690:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1787432419.278716:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1787432419.278746:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787432419.279324:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787432419.279346:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787432419.279362:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787432419.279374:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787432419.279376:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787432419.282075:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787432419.282347:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787432419.282377:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787432419.282394:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787432419.282406:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787432419.282408:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787432419.286124:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1787432419.286214:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1787432419.286233:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787432419.286612:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1787432419.286634:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1787432419.286647:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:2.0:1787432419.286664:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787432419.286682:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9484032e5200/0xca72b3b33563e8e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.286698:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948401683000/0xca72b3b33563e7ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e7a6 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.286706:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948400030c00/0xca72b3b33563e824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e81d expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.286712:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948401682200/0xca72b3b33563e85c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e855 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.286719:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948401683200/0xca72b3b33563e878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e871 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.286725:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484013fcc00/0xca72b3b33563e8a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e894 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.286740:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9484032e5200/0xca72b3b33563e8e1 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.286781:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484013fcc00/0xca72b3b33563e8a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e894 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.286794:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9484013fcc00/0xca72b3b33563e8a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e894 expref: 18 pid: 6507 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432419.286819:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbe680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874258609326592:0@lo:104: 00000100:00100000:2.0:1787432419.286885:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432419.287071:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948401683200/0xca72b3b33563e878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e871 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.287080:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948401683200/0xca72b3b33563e878 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e871 expref: 18 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432419.287088:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874258609326720:0@lo:104: 00000100:00100000:2.0:1787432419.287124:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432419.287155:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948401682200/0xca72b3b33563e85c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e855 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432419.287317:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609326592 00000100:00100000:1.0:1787432419.287326:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609326592 00000100:00100000:1.0:1787432419.287368:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609326720 00000100:00100000:1.0:1787432419.287371:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609326720 00000100:00100000:1.0:1787432419.287386:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432419.287397:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6507:x1874258609326592:12345-0@lo:104: 00010000:00010000:1.0:1787432419.287414:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e8a2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.287477:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787432419.287483:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6507:x1874258609326592:12345-0@lo:104: Request processed in 88us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432419.287490:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432419.287509:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787432419.287515:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6507:x1874258609326720:12345-0@lo:104: 00010000:00010000:1.0:1787432419.287523:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948400031600/0xca72b3b33563e871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e878 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.287555:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787432419.287569:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6507:x1874258609326720:12345-0@lo:104: Request processed in 54us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432419.287574:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1787432419.287592:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432419.287598:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e8a2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.287605:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fd000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432419.287609:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e8a2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.287617:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e8a2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432419.287624:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e8a2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432419.287629:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432419.287655:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e894 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e8a2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.287662:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432419.287681:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e894 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e8a2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.287689:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e894 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e8a2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.287701:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432419.287705:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948400031600/0xca72b3b33563e871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e878 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.287721:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400031600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432419.287724:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948400031600/0xca72b3b33563e871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e878 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.287730:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948400031600/0xca72b3b33563e871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e878 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432419.287736:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948400031600/0xca72b3b33563e871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e878 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432419.287740:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432419.287755:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948400031600/0xca72b3b33563e871 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e878 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.287760:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432419.287775:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948400031600/0xca72b3b33563e871 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e878 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.287782:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948400031600/0xca72b3b33563e871 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e878 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.287792:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432419.287807:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432419.287809:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432419.287816:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432419.287843:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609326976:0@lo:103: 00000100:00100000:1.0:1787432419.287872:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432419.287902:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432419.287909:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609327104:0@lo:103: 00000100:00100000:1.0:1787432419.288621:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432419.288664:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609326976 00000100:00100000:1.0:1787432419.288669:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609326976 00010000:00010000:1.0:1787432419.288695:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484013fcc00/0xca72b3b33563e8a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e894 expref: 19 pid: 6507 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432419.288718:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609327104 00000100:00100000:1.0:1787432419.288721:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609327104 00010000:00010000:1.0:1787432419.288731:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948401683200/0xca72b3b33563e878 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e871 expref: 20 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432419.288750:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432419.288758:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:3642:x1874258609326976:12345-0@lo:103: 00010000:00010000:1.0:1787432419.288770:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432419.288776:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484013fcc00/0xca72b3b33563e8a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e894 expref: 20 pid: 6507 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.289097:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948401682200/0xca72b3b33563e85c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e855 expref: 20 pid: 6507 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432419.289122:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbdc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874258609326848:0@lo:104: 00000100:00100000:2.0:1787432419.289186:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432419.289262:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609326848 00000100:00100000:3.0:1787432419.289267:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609326848 00000100:00100000:3.0:1787432419.289297:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787432419.289303:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6507:x1874258609326848:12345-0@lo:104: 00010000:00010000:3.0:1787432419.289313:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948400031c00/0xca72b3b33563e855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e85c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.289358:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787432419.289364:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6507:x1874258609326848:12345-0@lo:104: Request processed in 61us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432419.289370:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787432419.289619:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484013fcc00/0xca72b3b33563e8a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e894 expref: 20 pid: 6507 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.289637:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432419.289719:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:3642:x1874258609326976:12345-0@lo:103: Request processed in 962us (1846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432419.289726:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432419.289741:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787432419.289748:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:3644:x1874258609327104:12345-0@lo:103: 00010000:00010000:1.0:1787432419.289757:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432419.289762:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948401683200/0xca72b3b33563e878 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e871 expref: 19 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.289786:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948401683200/0xca72b3b33563e878 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e871 expref: 19 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.290188:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432419.290224:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:3644:x1874258609327104:12345-0@lo:103: Request processed in 476us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432419.290231:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1787432419.290269:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432419.290274:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948400031c00/0xca72b3b33563e855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e85c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.290283:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400031c00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432419.290287:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948400031c00/0xca72b3b33563e855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e85c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.290296:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948400031c00/0xca72b3b33563e855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e85c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432419.290303:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948400031c00/0xca72b3b33563e855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e85c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432419.290309:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432419.290340:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948400031c00/0xca72b3b33563e855 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e85c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.290346:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432419.290357:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948400031c00/0xca72b3b33563e855 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e85c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.290364:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948400031c00/0xca72b3b33563e855 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e85c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.290384:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432419.290386:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432419.290387:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432419.290394:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432419.290408:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609327232:0@lo:103: 00000100:00100000:1.0:1787432419.290436:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432419.290471:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609327232 00000100:00100000:1.0:1787432419.290475:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609327232 00010000:00010000:1.0:1787432419.290491:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948401682200/0xca72b3b33563e85c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e855 expref: 19 pid: 6507 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432419.290510:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787432419.290517:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:3643:x1874258609327232:12345-0@lo:103: 00010000:00010000:1.0:1787432419.290525:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432419.290529:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948401682200/0xca72b3b33563e85c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e855 expref: 19 pid: 6507 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.290539:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948401682200/0xca72b3b33563e85c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e855 expref: 19 pid: 6507 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.290549:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432419.290577:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:3643:x1874258609327232:12345-0@lo:103: Request processed in 61us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432419.290582:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787432419.290615:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609327232:0@lo:103: 00000100:00100000:1.0:1787432419.290639:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609327104:0@lo:103: 00000100:00100000:3.0:1787432419.290712:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609326976:0@lo:103: 00010000:00010000:2.0:1787432419.290928:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948400030c00/0xca72b3b33563e824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e81d expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.291070:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948400030c00/0xca72b3b33563e824 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e81d expref: 18 pid: 6508 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432419.291081:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874258609327360:0@lo:104: 00000100:00100000:2.0:1787432419.291119:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432419.291161:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948401683000/0xca72b3b33563e7ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e7a6 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.291194:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948401683000/0xca72b3b33563e7ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e7a6 expref: 18 pid: 6507 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432419.291202:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874258609327488:0@lo:104: 00000100:00100000:2.0:1787432419.291224:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432419.291249:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484034cdd80 going to sleep for 11 seconds 00010000:00010000:2.0:1787432419.291262:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fcc00/0xca72b3b33563e8a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e894 expref: 18 pid: 6507 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432419.291273:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbe680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874258609326592:0@lo:104: 00010000:00010000:2.0:1787432419.291282:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948401683200/0xca72b3b33563e878 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e871 expref: 17 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432419.291289:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874258609326720:0@lo:104: 00010000:00010000:2.0:1787432419.291297:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948401682200/0xca72b3b33563e85c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e855 expref: 16 pid: 6507 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432419.291304:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbdc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874258609326848:0@lo:104: 00000100:00100000:3.0:1787432419.291357:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609327360 00000100:00100000:3.0:1787432419.291362:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609327360 00000100:00100000:3.0:1787432419.291395:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609327488 00000100:00100000:3.0:1787432419.291399:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609327488 00000100:00100000:3.0:1787432419.291412:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787432419.291418:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6507:x1874258609327360:12345-0@lo:104: 00010000:00010000:3.0:1787432419.291427:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948400030000/0xca72b3b33563e81d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e824 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.291468:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787432419.291473:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6507:x1874258609327360:12345-0@lo:104: Request processed in 55us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432419.291479:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787432419.291492:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787432419.291498:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6507:x1874258609327488:12345-0@lo:104: 00010000:00010000:3.0:1787432419.291505:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563e7a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e7ad expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.291533:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787432419.291538:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6507:x1874258609327488:12345-0@lo:104: Request processed in 41us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432419.291544:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787432419.291610:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432419.291621:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948400030000/0xca72b3b33563e81d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e824 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.291628:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432419.291633:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948400030000/0xca72b3b33563e81d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e824 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.291640:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948400030000/0xca72b3b33563e81d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e824 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432419.291646:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948400030000/0xca72b3b33563e81d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e824 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432419.291651:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432419.291680:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948400030000/0xca72b3b33563e81d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e824 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.291686:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432419.291702:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948400030000/0xca72b3b33563e81d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e824 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.291708:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948400030000/0xca72b3b33563e81d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e824 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.291719:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432419.291721:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563e7a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e7ad expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.291727:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e4c00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432419.291729:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563e7a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e7ad expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.291747:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563e7a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e7ad expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432419.291754:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563e7a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e7ad expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432419.291759:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432419.291773:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563e7a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e7ad expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.291779:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432419.291784:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563e7a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e7ad expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.291790:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563e7a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e7ad expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.291870:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432419.291873:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432419.291875:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432419.291901:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609327616:0@lo:103: 00000100:00100000:1.0:1787432419.291994:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432419.292017:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432419.292021:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609327744:0@lo:103: 00000100:00100000:1.0:1787432419.292043:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432419.292062:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609327616 00000100:00100000:1.0:1787432419.292065:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609327616 00010000:00010000:1.0:1787432419.292078:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948400030c00/0xca72b3b33563e824 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e81d expref: 16 pid: 6508 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432419.292115:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609327744 00000100:00100000:1.0:1787432419.292118:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609327744 00010000:00010000:1.0:1787432419.292128:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948401683000/0xca72b3b33563e7ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e7a6 expref: 17 pid: 6507 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432419.292142:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787432419.292146:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:3641:x1874258609327616:12345-0@lo:103: 00010000:00010000:1.0:1787432419.292153:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432419.292157:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948400030c00/0xca72b3b33563e824 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e81d expref: 17 pid: 6508 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.292183:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948400030c00/0xca72b3b33563e824 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e81d expref: 17 pid: 6508 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.292196:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432419.292219:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:3641:x1874258609327616:12345-0@lo:103: Request processed in 72us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432419.292224:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787432419.292235:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787432419.292240:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94841223f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:3641:x1874258609327744:12345-0@lo:103: 00010000:00010000:1.0:1787432419.292246:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432419.292249:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948401683000/0xca72b3b33563e7ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e7a6 expref: 16 pid: 6507 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.292257:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948401683000/0xca72b3b33563e7ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e7a6 expref: 16 pid: 6507 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.292267:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9484032e5200/0xca72b3b33563e8e1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.292279:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e5200/0xca72b3b33563e8e1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.292291:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9484032e5200/0xca72b3b33563e8e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.292297:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9484032e5200/0xca72b3b33563e8e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.292304:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9484032e5200/0xca72b3b33563e8e1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.292310:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9484032e5200/0xca72b3b33563e8e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.292314:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e5200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432419.292318:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9484032e5200/0xca72b3b33563e8e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.292324:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9484032e5200/0xca72b3b33563e8e1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.292330:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9484032e5200/0xca72b3b33563e8e1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.292338:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432419.292361:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94841223f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:3641:x1874258609327744:12345-0@lo:103: Request processed in 120us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432419.292366:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787432419.292421:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609327744:0@lo:103: 00000100:00100000:1.0:1787432419.292437:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609327616:0@lo:103: 00010000:00010000:1.0:1787432419.292454:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432419.292643:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948400030c00/0xca72b3b33563e824 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e81d expref: 15 pid: 6508 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432419.292659:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874258609327360:0@lo:104: 00010000:00010000:2.0:1787432419.292668:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948401683000/0xca72b3b33563e7ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e7a6 expref: 14 pid: 6507 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432419.292675:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6507:1874258609327488:0@lo:104: 00010000:00010000:2.0:1787432419.292694:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9484032e5200/0xca72b3b33563e8e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.292702:0:6507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9484032e5200/0xca72b3b33563e8e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.292709:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9484032e5200/0xca72b3b33563e8e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.292715:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e5200/0xca72b3b33563e8e1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787432419.292727:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787432419.297992:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+13:8423:x1874258609325824:12345-0@lo:253: Request processed in 23261us (23498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432419.298008:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787432419.298201:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609325824:0@lo:253: 10000000:01000000:3.0:1787432419.298218:0:8423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787432419.298222:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787432419.298224:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787432419.298225:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432419.298226:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787432419.298245:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432419.298246:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432419.298248:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787432419.298250:0:8423:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787432419.298252:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432419.298253:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787432419.298274:0:8423:0:(tgt_mount.c:101:server_register_mount()) register mount ffff948435a21000 from lustre-OST0000 10000000:01000000:3.0:1787432419.298303:0:8423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787432419.298306:0:8423:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787432419.298315:0:8423:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9484336199b8 local copy 10000000:01000000:3.0:1787432419.298319:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787432419.298355:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e8e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.298367:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e8e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.298377:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e8e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432419.298396:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609327872:0@lo:101: 00000100:00100000:3.0:1787432419.298433:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432419.298468:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d67cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432419.299464:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609327872 00000100:00100000:1.0:1787432419.299474:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609327872 00000100:00100000:1.0:1787432419.299525:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787432419.299536:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+13:8423:x1874258609327872:12345-0@lo:101: 00010000:00010000:1.0:1787432419.299551:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432419.299568:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948401682800/0xca72b3b33563e8ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e8e8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.299593:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948401682800/0xca72b3b33563e8ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e8e8 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.299604:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948401682800/0xca72b3b33563e8ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e8e8 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.299613:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948401682800, rc 0) 00000100:00100000:1.0:1787432419.299670:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:8423:x1874258609327872:12345-0@lo:101: Request processed in 135us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432419.299676:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787432419.299717:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609327872:0@lo:101: 00010000:00010000:3.0:1787432419.299733:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e8e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xca72b3b33563e8ef expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.299743:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e8e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xca72b3b33563e8ef expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432419.299860:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609328000:0@lo:501: 00000100:00100000:3.0:1787432419.299891:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432419.299952:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d67cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432419.300054:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609328000 00000100:00100000:2.0:1787432419.300059:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609328000 00000100:00100000:2.0:1787432419.300097:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787432419.300114:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:8423:x1874258609328000:12345-0@lo:501: 00000100:00100000:2.0:1787432419.300213:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:8423:x1874258609328000:12345-0@lo:501: Request processed in 99us (321us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787432419.300221:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787432419.300496:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609328000:0@lo:501: 10000000:01000000:3.0:1787432419.300510:0:8423:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787432419.300527:0:8423:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787432419.300533:0:8423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e8e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xca72b3b33563e8ef expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.300542:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e8e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xca72b3b33563e8ef expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.300548:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e8e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xca72b3b33563e8ef expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.300573:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787432419.300595:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff948435a21000 10000000:01000000:3.0:1787432419.300600:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787432419.300604:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787432419.300607:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787432419.300611:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787432419.300613:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787432419.300633:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fce00/0xca72b3b33563e8f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.300640:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484013fce00/0xca72b3b33563e8f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.300648:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484013fce00/0xca72b3b33563e8f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432419.300660:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609328128:0@lo:101: 00000100:00100000:3.0:1787432419.300694:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432419.300724:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d67f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432419.300779:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609328128 00000100:00100000:2.0:1787432419.300784:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609328128 00000100:00100000:2.0:1787432419.300814:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787432419.300821:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:8423:x1874258609328128:12345-0@lo:101: 00010000:00010000:2.0:1787432419.300828:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432419.300837:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484032e5400/0xca72b3b33563e8fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e8f6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.300853:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e5400/0xca72b3b33563e8fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e8f6 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.300862:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484032e5400/0xca72b3b33563e8fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e8f6 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.300870:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e5400, rc 0) 00000100:00100000:2.0:1787432419.300910:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:8423:x1874258609328128:12345-0@lo:101: Request processed in 89us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432419.300916:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787432419.301110:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609328128:0@lo:101: 00010000:00010000:3.0:1787432419.301123:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484013fce00/0xca72b3b33563e8f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e8fd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.301131:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484013fce00/0xca72b3b33563e8f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e8fd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432419.301215:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609328256:0@lo:501: 00000100:00100000:3.0:1787432419.301244:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432419.301261:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d67f00 going to sleep for 11 seconds 00010000:00010000:1.0:1787432419.301340:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432419.301347:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e8e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xca72b3b33563e8ef expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.301355:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fd600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432419.301359:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e8e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xca72b3b33563e8ef expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.301366:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xca72b3b33563e8ef expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432419.301383:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xca72b3b33563e8ef expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432419.301389:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432419.301410:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e8e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xca72b3b33563e8ef expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.301416:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432419.301433:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e8e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xca72b3b33563e8ef expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.301439:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e8e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xca72b3b33563e8ef expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.301451:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432419.301453:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432419.301455:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432419.301462:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432419.301472:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609328384:0@lo:103: 00000100:00100000:1.0:1787432419.301501:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432419.301529:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609328384 00000100:00100000:1.0:1787432419.301533:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609328384 00000100:00100000:1.0:1787432419.301566:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787432419.301575:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:3644:x1874258609328384:12345-0@lo:103: 00010000:00010000:1.0:1787432419.301583:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432419.301594:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948401682800/0xca72b3b33563e8ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563e8e8 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.301604:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432419.301638:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:3644:x1874258609328384:12345-0@lo:103: Request processed in 64us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432419.301645:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787432419.301673:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609328384:0@lo:103: 00000100:00100000:2.0:1787432419.301789:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609328256 00000100:00100000:2.0:1787432419.301793:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609328256 00000100:00100000:2.0:1787432419.301814:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787432419.301820:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:8423:x1874258609328256:12345-0@lo:501: 00000100:00100000:2.0:1787432419.302090:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:8423:x1874258609328256:12345-0@lo:501: Request processed in 268us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432419.302098:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787432419.302203:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609328256:0@lo:501: 00000100:00100000:3.0:1787432419.302233:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609328512:0@lo:503: 00000100:00100000:3.0:1787432419.302274:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432419.302298:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d67f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432419.302366:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609328512 00000100:00100000:2.0:1787432419.302371:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609328512 00000100:00100000:2.0:1787432419.302397:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787432419.302404:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:8423:x1874258609328512:12345-0@lo:503: 00000100:00100000:2.0:1787432419.302493:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:8423:x1874258609328512:12345-0@lo:503: Request processed in 89us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432419.302500:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787432419.302578:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609328512:0@lo:503: 00000040:00080000:3.0:1787432419.302821:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787432419.302923:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609328640:0@lo:502: 00000100:00100000:3.0:1787432419.303029:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432419.303057:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d67f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432419.303389:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609328640 00000100:00100000:2.0:1787432419.303396:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609328640 00000100:00100000:2.0:1787432419.303420:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787432419.303426:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:8423:x1874258609328640:12345-0@lo:502: 00000100:00100000:2.0:1787432419.303510:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:8423:x1874258609328640:12345-0@lo:502: Request processed in 83us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432419.303518:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787432419.303594:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609328640:0@lo:502: 00000040:00080000:3.0:1787432419.303799:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787432419.303825:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787432419.303838:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787432419.303850:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787432419.303874:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787432419.303887:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787432419.304044:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609328768:0@lo:502: 00000100:00100000:3.0:1787432419.304086:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432419.304128:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d67f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432419.304208:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609328768 00000100:00100000:1.0:1787432419.304214:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609328768 00000100:00100000:1.0:1787432419.304242:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787432419.304250:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:8423:x1874258609328768:12345-0@lo:502: 00000100:00100000:1.0:1787432419.304341:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:8423:x1874258609328768:12345-0@lo:502: Request processed in 90us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432419.304348:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787432419.304489:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609328768:0@lo:502: 00000040:00080000:3.0:1787432419.304533:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787432419.304541:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787432419.305237:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787432419.305245:0:8446:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787432419.305252:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432419.305255:0:8446:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787432419.305260:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787432419.305274:0:8446:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff94843b95cd28) 00000020:00000080:1.0:1787432419.305293:0:8446:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787432419.305298:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787432419.305361:0:8446:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948435a21000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787432419.305370:0:8446:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787432419.305376:0:8446:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xca72b3b33563e90b 00010000:00010000:1.0:1787432419.311722:0:8446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1787432419.312456:0:8446:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787432419.315650:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787432419.316662:0:8446:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1787432419.328423:0:8446:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1787432419.328610:0:8446:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1787432419.340626:0:8446:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1787432419.345706:0:8446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787432419.345725:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432419.345732:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432419.345734:0:8446:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787432419.345737:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432419.345741:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432419.345742:0:8446:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787432419.345745:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787432419.345747:0:8446:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787432419.345778:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432419.345781:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432419.345782:0:8446:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787432419.345785:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787432419.347204:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787432419.347238:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787432419.347256:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fce00/0xca72b3b33563e8f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e8fd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432419.347269:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484013fce00/0xca72b3b33563e8f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e8fd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432419.347277:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948435a21000 from 1 10000000:01000000:0.0:1787432419.347280:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787432419.347321:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948400030e00/0xca72b3b33563e912 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432419.347329:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948400030e00/0xca72b3b33563e912 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432419.347341:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948400030e00/0xca72b3b33563e912 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432419.347364:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405943800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609328896:0@lo:101: 00000100:00100000:0.0:1787432419.347428:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432419.347468:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484052ec000 going to sleep for 11 seconds 00000100:00100000:1.0:1787432419.348719:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609328896 00000100:00100000:1.0:1787432419.348730:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609328896 00000100:00100000:1.0:1787432419.348778:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787432419.348788:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:8423:x1874258609328896:12345-0@lo:101: 00010000:00010000:1.0:1787432419.348814:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432419.348831:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948401682800/0xca72b3b33563e919 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e912 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.348856:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948401682800/0xca72b3b33563e919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e912 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.348867:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948401682800/0xca72b3b33563e919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e912 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.348875:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948401682800, rc 0) 00000100:00100000:1.0:1787432419.349071:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:8423:x1874258609328896:12345-0@lo:101: Request processed in 284us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432419.349079:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787432419.349434:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405943800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609328896:0@lo:101: 00010000:00010000:0.0:1787432419.349453:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948400030e00/0xca72b3b33563e912 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e919 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432419.349462:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948400030e00/0xca72b3b33563e912 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e919 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432419.349561:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405943800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609329024:0@lo:501: 00000100:00100000:0.0:1787432419.349608:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432419.349643:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484052ec000 going to sleep for 11 seconds 00000100:00100000:1.0:1787432419.349705:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609329024 00000100:00100000:1.0:1787432419.349715:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609329024 00000100:00100000:1.0:1787432419.349750:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787432419.349758:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:8423:x1874258609329024:12345-0@lo:501: 00000100:00100000:1.0:1787432419.349872:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:8423:x1874258609329024:12345-0@lo:501: Request processed in 113us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432419.349879:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787432419.350135:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405943800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609329024:0@lo:501: 00000100:00100000:3.0:1787432419.350196:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609329152:0@lo:503: 00000100:00100000:3.0:1787432419.350240:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432419.350260:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d67f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432419.350322:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609329152 00000100:00100000:0.0:1787432419.350327:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609329152 00000100:00100000:0.0:1787432419.350360:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787432419.350367:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:8423:x1874258609329152:12345-0@lo:503: 00000100:00100000:0.0:1787432419.350443:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:8423:x1874258609329152:12345-0@lo:503: Request processed in 77us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432419.350450:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787432419.350540:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609329152:0@lo:503: 00000040:00080000:3.0:1787432419.350748:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787432419.350819:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609329280:0@lo:502: 00000100:00100000:3.0:1787432419.350856:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432419.350885:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d67f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432419.351114:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609329280 00000100:00100000:0.0:1787432419.351119:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609329280 00000100:00100000:0.0:1787432419.351152:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787432419.351158:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:8423:x1874258609329280:12345-0@lo:502: 00000100:00100000:0.0:1787432419.351259:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:8423:x1874258609329280:12345-0@lo:502: Request processed in 100us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432419.351266:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787432419.353310:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609329280:0@lo:502: 00000040:00080000:3.0:1787432419.353556:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787432419.353588:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787432419.353621:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609329408:0@lo:502: 00000100:00100000:3.0:1787432419.353688:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432419.353731:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d67f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432419.353802:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609329408 00000100:00100000:1.0:1787432419.353809:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609329408 00000100:00100000:1.0:1787432419.353858:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787432419.353868:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:8423:x1874258609329408:12345-0@lo:502: 00000100:00100000:1.0:1787432419.354197:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:8423:x1874258609329408:12345-0@lo:502: Request processed in 329us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432419.354205:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787432419.354359:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609329408:0@lo:502: 00000040:00080000:3.0:1787432419.354405:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787432419.354422:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787432419.354875:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432419.354886:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432419.354888:0:8449:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787432419.355069:0:8449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948435a21000 00000020:00000080:0.0:1787432419.355072:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787432419.355086:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432419.355089:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432419.355090:0:8449:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787432419.355093:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787432419.355288:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787432419.355312:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787432419.355334:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948400030e00/0xca72b3b33563e912 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e919 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.355346:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948400030e00/0xca72b3b33563e912 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e919 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432419.355389:0:8423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787432419.355392:0:8423:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff948435a21000 10000000:01000000:3.0:1787432419.355395:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff948435a21000 10000000:01000000:3.0:1787432419.355398:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787432419.355403:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948435a21000 from 1 10000000:01000000:3.0:1787432419.355406:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787432419.355433:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fdc00/0xca72b3b33563e920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.355440:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484013fdc00/0xca72b3b33563e920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.355449:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484013fdc00/0xca72b3b33563e920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432419.355465:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609329536:0@lo:101: 00000100:00100000:3.0:1787432419.355506:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432419.355545:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d67f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432419.355908:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609329536 00000100:00100000:0.0:1787432419.355915:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609329536 00000100:00100000:0.0:1787432419.356081:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787432419.356092:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:8423:x1874258609329536:12345-0@lo:101: 00010000:00010000:0.0:1787432419.356121:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432419.356134:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948400030c00/0xca72b3b33563e927 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e920 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432419.356157:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948400030c00/0xca72b3b33563e927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e920 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432419.356191:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948400030c00/0xca72b3b33563e927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e920 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432419.356200:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948400030c00, rc 0) 00000100:00100000:0.0:1787432419.356251:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:8423:x1874258609329536:12345-0@lo:101: Request processed in 161us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432419.356258:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787432419.356380:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609329536:0@lo:101: 00010000:00010000:3.0:1787432419.356395:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484013fdc00/0xca72b3b33563e920 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e927 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.356416:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484013fdc00/0xca72b3b33563e920 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e927 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432419.356493:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609329664:0@lo:501: 00000100:00100000:3.0:1787432419.356531:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432419.357137:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d67f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432419.365435:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609329664 00000100:00100000:1.0:1787432419.365451:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609329664 00000100:00100000:1.0:1787432419.365576:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787432419.365589:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:8423:x1874258609329664:12345-0@lo:501: 00000100:00100000:1.0:1787432419.366127:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:8423:x1874258609329664:12345-0@lo:501: Request processed in 539us (9595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432419.366135:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787432419.366369:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609329664:0@lo:501: 00000100:00100000:3.0:1787432419.366420:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609329792:0@lo:503: 00000100:00100000:3.0:1787432419.366468:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432419.366509:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d67f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432419.367583:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609329792 00000100:00100000:1.0:1787432419.367594:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609329792 00000100:00100000:1.0:1787432419.367637:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787432419.367645:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:8423:x1874258609329792:12345-0@lo:503: 00000100:00100000:1.0:1787432419.367782:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:8423:x1874258609329792:12345-0@lo:503: Request processed in 137us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432419.367790:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787432419.368336:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609329792:0@lo:503: 00000040:00080000:0.0:1787432419.368609:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787432419.368685:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405942d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609329920:0@lo:502: 00000100:00100000:0.0:1787432419.368736:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432419.368777:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484052eca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432419.369011:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609329920 00000100:00100000:1.0:1787432419.369016:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609329920 00000100:00100000:1.0:1787432419.369051:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787432419.369059:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:8423:x1874258609329920:12345-0@lo:502: 00000100:00100000:1.0:1787432419.369160:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:8423:x1874258609329920:12345-0@lo:502: Request processed in 101us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432419.369193:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787432419.369314:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405942d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609329920:0@lo:502: 00000040:00080000:0.0:1787432419.369500:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787432419.369526:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787432419.369541:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787432419.369555:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787432419.369569:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787432419.369583:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787432419.369594:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787432419.369605:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787432419.369627:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787432419.369638:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787432419.369649:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787432419.369662:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787432419.369675:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787432419.369686:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787432419.369698:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787432419.369711:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787432419.369724:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787432419.369736:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787432419.369749:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787432419.369778:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787432419.369793:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787432419.370246:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787432419.370259:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787432419.370273:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787432419.370284:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787432419.370295:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787432419.370307:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787432419.370319:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1787432419.370331:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787432419.370345:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1787432419.370359:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1787432419.370370:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1787432419.370382:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1787432419.370395:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1787432419.370409:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1787432419.370549:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1787432419.370569:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1787432419.370605:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405942d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609330048:0@lo:502: 00000100:00100000:0.0:1787432419.370661:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432419.370805:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484052eca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432419.379322:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609330048 00000100:00100000:1.0:1787432419.379338:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609330048 00000100:00100000:0.0:1787432419.379468:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787432419.379480:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:8423:x1874258609330048:12345-0@lo:502: 00000100:00100000:0.0:1787432419.379698:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:8423:x1874258609330048:12345-0@lo:502: Request processed in 220us (9036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432419.379707:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787432419.379970:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405942d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609330048:0@lo:502: 00000040:00080000:2.0:1787432419.380064:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1787432419.380078:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787432419.380791:0:8451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787432419.380817:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff94843361cd28) 00000020:00000080:0.0:1787432419.380841:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1787432419.380939:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948435a21000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787432419.380944:0:8451:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948435a21000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787432419.380947:0:8451:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948435a21000 3 00010000:00080000:0.0:1787432419.380977:0:8451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9484166d2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.124@tcp at head 00010000:00010000:0.0:1787432419.382690:0:8451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1787432419.386707:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787432419.386763:0:8451:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787432419.386776:0:8451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xca72b3b33563e935 00000100:00080000:0.0:1787432419.386788:0:8451:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787432419.386794:0:8451:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9484166d2800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432419.386831:0:8451:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948405942d80 x1874258609330176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432419.386861:0:8451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787432419.387206:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874258609330176:0@lo:38: 00000100:00100000:3.0:1787432419.387286:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432419.387576:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609330176 00000100:00100000:0.0:1787432419.387586:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609330176 00000100:00100000:0.0:1787432419.387628:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432419.387637:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874258609330176:12345-0@lo:38: 00010000:00080000:0.0:1787432419.387663:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:0.0:1787432419.387721:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xca72b3b33563e93c 00000004:00100000:0.0:1787432419.387737:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787432419.387774:0:6513:0:(import.c:65:import_set_state_nolock()) ffff94843b951800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432419.387834:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874258609330176:12345-0@lo:38: Request processed in 196us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432419.387842:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787432419.388012:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948405942d80 x1874258609330176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432419.388023:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787432419.388031:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787432419.388038:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787432419.388042:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787432419.388045:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484166d2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787432419.388050:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874258609330176:0@lo:38: 00000020:01000004:1.0:1787432419.388994:0:8451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787432419.389014:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff94843b9599b8) 00000020:00000080:1.0:1787432419.389034:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1787432419.389123:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948435a21000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787432419.389127:0:8451:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948435a21000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787432419.389129:0:8451:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948435a21000 3 00010000:00080000:1.0:1787432419.389160:0:8451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948301dd3000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.124@tcp at head 00010000:00010000:1.0:1787432419.391364:0:8451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1787432419.391563:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1787432419.391608:0:8451:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787432419.391620:0:8451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xca72b3b33563e94a 00000100:00080000:1.0:1787432419.391631:0:8451:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787432419.391637:0:8451:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff948301dd3000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432419.391673:0:8451:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948301e3a680 x1874258609330304/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787432419.391712:0:8451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787432419.391790:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1874258609330304:0@lo:38: 00000100:00100000:0.0:1787432419.391873:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432419.393048:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609330304 00000100:00100000:2.0:1787432419.393058:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609330304 00000100:00100000:2.0:1787432419.393115:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787432419.393122:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874258609330304:12345-0@lo:38: 00010000:00080000:2.0:1787432419.393150:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:2.0:1787432419.396016:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xca72b3b33563e951 00000004:00100000:2.0:1787432419.396045:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787432419.396091:0:6514:0:(import.c:65:import_set_state_nolock()) ffff948301dc6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432419.396221:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874258609330304:12345-0@lo:38: Request processed in 3095us (4345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432419.396232:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787432419.396303:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948301e3a680 x1874258609330304/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432419.396326:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787432419.396336:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787432419.396344:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787432419.396349:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787432419.396352:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948301dd3000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787432419.396358:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1874258609330304:0@lo:38: 00000040:00080000:1.0:1787432419.410605:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1787432419.410721:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787432419.410750:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787432419.410767:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fdc00/0xca72b3b33563e920 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e927 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432419.410788:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484013fdc00/0xca72b3b33563e920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e927 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787432419.410863:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787432419.410865:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787432419.410867:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432419.410868:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432419.410869:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432419.410870:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432419.410872:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787432419.410874:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787432419.410875:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787432419.410877:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432419.410878:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787432419.410882:0:8423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787432419.410884:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787432419.410886:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787432419.410887:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432419.410888:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432419.410889:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432419.410890:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432419.410891:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787432419.410892:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787432419.410893:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787432419.410894:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432419.410895:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787432419.410919:0:8423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787432419.411115:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609330432:0@lo:253: 00000100:00100000:1.0:1787432419.411209:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432419.411253:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335af240 going to sleep for 11 seconds 00000100:00100000:3.0:1787432419.411512:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609330432 00000100:00100000:3.0:1787432419.411520:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609330432 00000100:00100000:3.0:1787432419.412421:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787432419.412435:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:8423:x1874258609330432:12345-0@lo:253: 20000000:01000000:3.0:1787432419.412477:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787432419.412491:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787432419.420006:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787432419.420029:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787432419.420464:0:6529:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787432419.420470:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787432419.420491:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948400030000/0xca72b3b33563e958 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432419.420508:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484013fc800/0xca72b3b33563e84e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e847 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432419.420516:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484013fd400/0xca72b3b33563e86a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e863 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432419.420524:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948400030000/0xca72b3b33563e958 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432419.420562:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484013fd400/0xca72b3b33563e86a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e863 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432419.420576:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9484013fd400/0xca72b3b33563e86a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e863 expref: 16 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432419.420578:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:8423:x1874258609330432:12345-0@lo:253: Request processed in 8146us (9367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432419.420588:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787432419.420590:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405941880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1874258609330560:0@lo:104: 00000100:00100000:0.0:1787432419.420630:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432419.420662:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1787432419.420671:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484013fc800/0xca72b3b33563e84e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e847 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432419.420672:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609330560 00000100:00100000:3.0:1787432419.420678:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609330560 00010000:00010000:0.0:1787432419.420695:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9484013fc800/0xca72b3b33563e84e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e847 expref: 15 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432419.420705:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405940000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1874258609330688:0@lo:104: 00000100:00100000:0.0:1787432419.420728:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432419.420751:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358d7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787432419.420809:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:8423:1874258609330432:0@lo:253: 10000000:01000000:1.0:1787432419.420821:0:8423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787432419.420824:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787432419.420825:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787432419.420832:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432419.420834:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432419.420835:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432419.420836:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432419.420837:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787432419.420839:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787432419.420840:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787432419.420842:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432419.420843:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787432419.420855:0:8423:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787432419.420864:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609330688 00000100:00100000:2.0:1787432419.420868:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609330688 00000100:00100000:2.0:1787432419.420996:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432419.421008:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405943480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6529:x1874258609330688:12345-0@lo:104: 00010000:00010000:2.0:1787432419.421020:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948400031400/0xca72b3b33563e847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e84e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.421071:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787432419.421077:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405943480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6529:x1874258609330688:12345-0@lo:104: Request processed in 73us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432419.421083:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432419.421126:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405940000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1874258609330688:0@lo:104: 00010000:00010000:2.0:1787432419.421138:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432419.421143:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948400031400/0xca72b3b33563e847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e84e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.421150:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400031400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432419.421154:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948400031400/0xca72b3b33563e847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e84e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.421194:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948400031400/0xca72b3b33563e847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e84e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432419.421201:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948400031400/0xca72b3b33563e847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e84e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432419.421207:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787432419.421236:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948400031400/0xca72b3b33563e847 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e84e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.421243:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432419.421263:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948400031400/0xca72b3b33563e847 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e84e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.421270:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948400031400/0xca72b3b33563e847 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e84e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.421282:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432419.421284:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432419.421285:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432419.421310:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609330816:0@lo:103: 00000100:00100000:2.0:1787432419.421340:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432419.421377:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609330816 00000100:00100000:2.0:1787432419.421380:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609330816 00010000:00010000:2.0:1787432419.421397:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484013fc800/0xca72b3b33563e84e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e847 expref: 16 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432419.421420:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432419.421427:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:3644:x1874258609330816:12345-0@lo:103: 00010000:00010000:2.0:1787432419.421443:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432419.421449:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484013fc800/0xca72b3b33563e84e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e847 expref: 16 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.421458:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484013fc800/0xca72b3b33563e84e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e847 expref: 16 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.421472:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fc800/0xca72b3b33563e84e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e847 expref: 16 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.421483:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432419.421511:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:3644:x1874258609330816:12345-0@lo:103: Request processed in 86us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432419.421518:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432419.421546:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609330816:0@lo:103: 00000100:00100000:2.0:1787432419.422501:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787432419.422514:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843c558450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6529:x1874258609330560:12345-0@lo:104: 00010000:00010000:2.0:1787432419.422526:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563e863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e86a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432419.422589:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787432419.422596:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843c558450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6529:x1874258609330560:12345-0@lo:104: Request processed in 87us (1966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432419.422602:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1787432419.422651:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432419.422658:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563e863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e86a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.422665:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e4800 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1787432419.422669:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563e863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e86a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.422677:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563e863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e86a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432419.422684:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563e863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e86a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432419.422690:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405941880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1874258609330560:0@lo:104: 00010000:00010000:0.0:1787432419.422708:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948400030000/0xca72b3b33563e958 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432419.422758:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787432419.422800:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563e863 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e86a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.422807:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787432419.422833:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563e863 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e86a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432419.422854:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1787432419.422855:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563e863 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e86a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432419.422864:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609330944:0@lo:103: 00010000:00010000:3.0:1787432419.422869:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432419.422871:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432419.422872:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432419.422894:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432419.422952:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609330944 00000100:00100000:3.0:1787432419.422957:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609330944 00010000:00010000:3.0:1787432419.422976:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484013fd400/0xca72b3b33563e86a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e863 expref: 15 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432419.423007:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787432419.423014:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:3642:x1874258609330944:12345-0@lo:103: 00010000:00010000:3.0:1787432419.423023:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432419.423028:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484013fd400/0xca72b3b33563e86a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e863 expref: 15 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.423038:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484013fd400/0xca72b3b33563e86a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e863 expref: 15 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.423051:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fd400/0xca72b3b33563e86a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e863 expref: 15 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.423065:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948400030000/0xca72b3b33563e958 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.423073:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948400030000/0xca72b3b33563e958 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787432419.423106:0:6499:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005818009s 00010000:00010000:3.0:1787432419.423111:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948400030000/0xca72b3b33563e958 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.423119:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948400030000/0xca72b3b33563e958 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.423126:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948400030000/0xca72b3b33563e958 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.423132:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948400030000/0xca72b3b33563e958 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.423137:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432419.423141:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948400030000/0xca72b3b33563e958 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.423148:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948400030000/0xca72b3b33563e958 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.423181:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948400030000/0xca72b3b33563e958 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432419.423191:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432419.423224:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:3642:x1874258609330944:12345-0@lo:103: Request processed in 211us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432419.423231:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787432419.423481:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609330944:0@lo:103: 00010000:00010000:0.0:1787432419.423562:0:6529:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948400030000/0xca72b3b33563e958 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432419.423571:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948400030000/0xca72b3b33563e958 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432419.423578:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948400030000/0xca72b3b33563e958 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787432419.427809:0:8423:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787432419.427981:0:8423:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787432419.428154:0:8423:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787432419.428327:0:8423:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787432419.428528:0:8423:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787432419.428736:0:8423:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1787432419.429882:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787432419.441901:0:8423:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787432419.441910:0:8423:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787432419.441966:0:8423:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787432419.442016:0:8423:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.124@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787432419.442037:0:8423:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787432419.442064:0:8423:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1787432419.442883:0:8423:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787432419.446246:0:8423:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1787432419.537996:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787432420.542224:0:8507:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432420.542446:0:8507:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787432420.576610:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432421.579342:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432422.352628:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609331072:0@lo:41: 00000100:00100000:0.0:1787432422.352699:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432422.354253:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609331072 00000100:00100000:0.0:1787432422.354263:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609331072 00000100:00100000:0.0:1787432422.356149:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787432422.356193:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609331072:12345-0@lo:41: 00000004:00000024:0.0:1787432422.356234:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1787432422.356860:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609331072:12345-0@lo:41: Request processed in 692us (4157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432422.356870:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787432422.357557:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609331072:0@lo:41: 00010000:00010000:1.0:1787432422.607194:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432423.627526:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432424.400838:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432424.400874:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609331200:0@lo:41: 00000100:00100000:3.0:1787432424.400952:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432424.401033:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609331200 00000100:00100000:3.0:1787432424.401041:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609331200 00000100:00100000:3.0:1787432424.401097:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787432424.401107:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609331200:12345-0@lo:41: 00000004:00000024:3.0:1787432424.401141:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1787432424.401217:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609331200:12345-0@lo:41: Request processed in 111us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432424.401225:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787432424.401274:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609331200:0@lo:41: 00010000:00010000:1.0:1787432424.653978:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432424.907364:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609331328:0@lo:400: 00000100:00100000:3.0:1787432424.907435:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432424.907573:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609331328 00000100:00100000:0.0:1787432424.907580:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609331328 00000100:00100000:0.0:1787432424.907629:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787432424.907638:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:3644:x1874258609331328:12345-0@lo:400: 00000100:00100000:0.0:1787432424.910807:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:3644:x1874258609331328:12345-0@lo:400: Request processed in 3160us (3361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432424.910822:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787432424.910888:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609331712:0@lo:400: 00000100:00100000:0.0:1787432424.910939:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432424.910976:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432424.910982:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609331840:0@lo:400: 00000100:00100000:0.0:1787432424.911018:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432424.911046:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609331456:0@lo:400: 00000100:00100000:2.0:1787432424.911199:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609331712 00000100:00100000:2.0:1787432424.911208:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609331712 00000100:00100000:2.0:1787432424.911244:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609331840 00000100:00100000:2.0:1787432424.911247:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609331840 00000100:00100000:2.0:1787432424.911278:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432424.911286:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609331712:12345-0@lo:400: 00000100:00100000:2.0:1787432424.911336:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609331712:12345-0@lo:400: Request processed in 51us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432424.911342:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432424.911355:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787432424.911363:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609331840:12345-0@lo:400: 00000100:00100000:2.0:1787432424.911385:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609331840:12345-0@lo:400: Request processed in 25us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432424.911390:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787432424.911474:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432424.911491:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609331968:0@lo:400: 00000100:00100000:0.0:1787432424.911535:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432424.911558:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432424.911565:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609331584:0@lo:400: 00000100:00100000:0.0:1787432424.911589:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432424.911623:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609331456 00000100:00100000:0.0:1787432424.911627:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609331456 00000100:00100000:0.0:1787432424.911643:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609331968 00000100:00100000:0.0:1787432424.911646:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609331968 00000100:00100000:0.0:1787432424.911661:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787432424.911668:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609331456:12345-0@lo:400: 00000100:00100000:0.0:1787432424.911701:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609331456:12345-0@lo:400: Request processed in 34us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432424.911707:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787432424.911719:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787432424.911726:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609331968:12345-0@lo:400: 00000100:00100000:0.0:1787432424.911751:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609331968:12345-0@lo:400: Request processed in 26us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432424.911756:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787432424.911772:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609331584 00000100:00100000:0.0:1787432424.911775:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609331584 00000100:00100000:0.0:1787432424.911799:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787432424.911805:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609331584:12345-0@lo:400: 00000100:00100000:0.0:1787432424.911835:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609331584:12345-0@lo:400: Request processed in 29us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432424.911841:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787432424.911942:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbfb80 x1874258609331840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432424.911959:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609331840:0@lo:400: 00010000:00080000:0.0:1787432424.911973:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbce00 x1874258609331712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432424.911981:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609331712:0@lo:400: 00000100:00100000:0.0:1787432424.912036:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609331584:0@lo:400: 00010000:00080000:0.0:1787432424.912046:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbf800 x1874258609331456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432424.912054:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609331456:0@lo:400: 00010000:00080000:0.0:1787432424.912146:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbdc00 x1874258609331968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432424.912155:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609331968:0@lo:400: 00000100:00080000:0.0:1787432424.912214:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787432424.912218:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432424.915425:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609331328:0@lo:400: 00010000:00010000:1.0:1787432425.678610:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432426.700152:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787432426.957367:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787432426.957375:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94842dfc5000 from 30 10000000:01000000:1.0:1787432426.957380:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787432426.957706:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563e95f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432426.957718:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563e95f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432426.957729:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563e95f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432426.957764:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609332096:0@lo:101: 00000100:00100000:1.0:1787432426.957836:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432426.957891:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432426.957971:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609332096 00000100:00100000:3.0:1787432426.957978:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609332096 00000100:00100000:3.0:1787432426.958035:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787432426.958044:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:6511:x1874258609332096:12345-0@lo:101: 00010000:00010000:3.0:1787432426.958056:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432426.958069:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484013fc800/0xca72b3b33563e966 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e95f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432426.958092:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fc800/0xca72b3b33563e966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e95f expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432426.958113:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484013fc800/0xca72b3b33563e966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e95f expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432426.958122:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fc800, rc 0) 00000100:00100000:3.0:1787432426.958194:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:6511:x1874258609332096:12345-0@lo:101: Request processed in 151us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432426.958201:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787432426.958306:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609332096:0@lo:101: 00010000:00010000:2.0:1787432426.958321:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563e95f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e966 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432426.958330:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563e95f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e966 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432426.958394:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609332224:0@lo:501: 00000100:00100000:2.0:1787432426.958435:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432426.958460:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d31a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787432426.959240:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609332224 00000100:00100000:3.0:1787432426.959247:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609332224 00000100:00100000:3.0:1787432426.959296:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787432426.959305:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:6511:x1874258609332224:12345-0@lo:501: 00000100:00100000:3.0:1787432426.959451:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:6511:x1874258609332224:12345-0@lo:501: Request processed in 146us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432426.959459:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787432426.959905:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609332224:0@lo:501: 00000100:00100000:2.0:1787432426.959961:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609332352:0@lo:503: 00000100:00100000:2.0:1787432426.960019:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432426.960057:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d31a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787432426.961786:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609332352 00000100:00100000:3.0:1787432426.961800:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609332352 00000100:00100000:3.0:1787432426.961866:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787432426.961877:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:6511:x1874258609332352:12345-0@lo:503: 00000100:00100000:3.0:1787432426.962052:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:6511:x1874258609332352:12345-0@lo:503: Request processed in 176us (2032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432426.962060:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787432426.962217:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609332352:0@lo:503: 00000100:00100000:2.0:1787432426.962965:0:8791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8791:1874258609332480:0@lo:502: 00000100:00100000:2.0:1787432426.963016:0:8791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432426.963057:0:8791:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d31300 going to sleep for 11 seconds 00000100:00100000:1.0:1787432426.963410:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609332480 00000100:00100000:1.0:1787432426.963425:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609332480 00000100:00100000:1.0:1787432426.963466:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787432426.963476:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:8791:x1874258609332480:12345-0@lo:502: 00000100:00100000:1.0:1787432426.963714:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:8791:x1874258609332480:12345-0@lo:502: Request processed in 238us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432426.963722:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787432426.963823:0:8791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8791:1874258609332480:0@lo:502: 00000100:00100000:2.0:1787432426.963870:0:8791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8791:1874258609332608:0@lo:502: 00000100:00100000:2.0:1787432426.963918:0:8791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432426.963945:0:8791:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d31300 going to sleep for 11 seconds 00000100:00100000:1.0:1787432426.964237:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609332608 00000100:00100000:1.0:1787432426.964243:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609332608 00000100:00100000:1.0:1787432426.964287:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787432426.964296:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:8791:x1874258609332608:12345-0@lo:502: 00000100:00100000:1.0:1787432426.964370:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:8791:x1874258609332608:12345-0@lo:502: Request processed in 76us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432426.964377:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787432426.964674:0:8791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8791:1874258609332608:0@lo:502: 00000040:00080000:2.0:1787432426.964697:0:8791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787432426.966695:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787432426.966736:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787432426.966748:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563e95f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e966 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432426.966760:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563e95f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e966 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432426.966769:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787432426.966780:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94842dfc5000 from 5 10000000:01000000:1.0:1787432426.966783:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787432426.966819:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401683600/0xca72b3b33563e96d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432426.966828:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948401683600/0xca72b3b33563e96d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432426.966838:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948401683600/0xca72b3b33563e96d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432426.966859:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e3aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609332736:0@lo:101: 00000100:00100000:1.0:1787432426.966934:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432426.966982:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432426.968942:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609332736 00000100:00100000:0.0:1787432426.968966:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609332736 00000100:00100000:0.0:1787432426.969031:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787432426.969041:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:6511:x1874258609332736:12345-0@lo:101: 00010000:00010000:0.0:1787432426.969056:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432426.969072:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948400031c00/0xca72b3b33563e974 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e96d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432426.969097:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948400031c00/0xca72b3b33563e974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e96d expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432426.969107:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948400031c00/0xca72b3b33563e974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e96d expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432426.969116:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948400031c00, rc 0) 00000100:00100000:0.0:1787432426.975375:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609332736:12345-0@lo:101: Request processed in 6044us (8149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432426.975389:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787432426.979343:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e3aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609332736:0@lo:101: 00010000:00010000:0.0:1787432426.979371:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948401683600/0xca72b3b33563e96d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e974 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432426.979385:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948401683600/0xca72b3b33563e96d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e974 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432426.979454:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609332864:0@lo:256: 00000100:00100000:0.0:1787432426.979517:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432426.981416:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432426.990134:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609332864 00000100:00100000:2.0:1787432426.990150:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609332864 00000100:00100000:2.0:1787432426.990723:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787432426.990736:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609332864:12345-0@lo:256: 20000000:01000000:2.0:1787432426.990762:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787432426.990787:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787432426.990791:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787432426.990974:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609332864:12345-0@lo:256: Request processed in 241us (11456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432426.990983:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787432426.991025:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609332864:0@lo:256: 10000000:01000000:2.0:1787432426.991076:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787432426.991088:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401683600/0xca72b3b33563e96d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e974 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432426.991104:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948401683600/0xca72b3b33563e96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e974 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432426.991114:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787432426.991117:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1787432426.991120:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787432426.991156:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563e97b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432426.991189:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563e97b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432426.991199:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563e97b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432426.991218:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609332992:0@lo:101: 00000100:00100000:2.0:1787432426.991255:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432426.991283:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d31a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432426.991298:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609332992 00000100:00100000:2.0:1787432426.991302:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609332992 00000100:00100000:2.0:1787432426.991580:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787432426.991592:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609332992:12345-0@lo:101: 00010000:00010000:2.0:1787432426.991602:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432426.991615:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484032e5200/0xca72b3b33563e982 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e97b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432426.991636:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e5200/0xca72b3b33563e982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e97b expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432426.991659:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484032e5200/0xca72b3b33563e982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e97b expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432426.991668:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e5200, rc 0) 00000100:00100000:2.0:1787432426.991705:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609332992:12345-0@lo:101: Request processed in 115us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432426.991711:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787432426.991742:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609332992:0@lo:101: 00010000:00010000:2.0:1787432426.991756:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563e97b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e982 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432426.991764:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563e97b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e982 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432426.991815:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609333120:0@lo:501: 00000100:00100000:2.0:1787432426.991841:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432426.991861:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d31a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432426.991874:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609333120 00000100:00100000:2.0:1787432426.991878:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609333120 00000100:00100000:2.0:1787432426.991894:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787432426.991900:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609333120:12345-0@lo:501: 00000100:00100000:2.0:1787432426.992088:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609333120:12345-0@lo:501: Request processed in 188us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432426.992095:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787432426.992128:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609333120:0@lo:501: 00000100:00100000:2.0:1787432426.992156:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609333248:0@lo:503: 00000100:00100000:2.0:1787432426.992228:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432426.992245:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d31a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432426.992258:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609333248 00000100:00100000:2.0:1787432426.992261:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609333248 00000100:00100000:2.0:1787432426.992278:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787432426.992284:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609333248:12345-0@lo:503: 00000100:00100000:2.0:1787432426.992434:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609333248:12345-0@lo:503: Request processed in 149us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432426.992440:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787432426.992477:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609333248:0@lo:503: 00000100:00100000:1.0:1787432426.993768:0:8795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e38000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8795:1874258609333376:0@lo:502: 00000100:00100000:1.0:1787432426.993829:0:8795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432426.993891:0:8795:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432426.994004:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609333376 00000100:00100000:2.0:1787432426.994009:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609333376 00000100:00100000:2.0:1787432426.994037:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787432426.994044:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:8795:x1874258609333376:12345-0@lo:502: 00000100:00100000:2.0:1787432426.994195:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:8795:x1874258609333376:12345-0@lo:502: Request processed in 151us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432426.994203:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787432426.994278:0:8795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e38000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8795:1874258609333376:0@lo:502: 00000020:01000000:1.0:1787432426.994304:0:8795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787432426.994311:0:8795:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787432426.994318:0:8795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432426.994320:0:8795:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787432426.994397:0:8795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787432426.994402:0:8795:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.124@tcp to nid 0x20000c0a8cc7c (192.168.204.124@tcp) 00000020:01000000:1.0:1787432426.994423:0:8795:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787432426.994426:0:8795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787432426.994439:0:8795:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff94843b95b370) 00000020:00000080:1.0:1787432426.994459:0:8795:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1787432426.994464:0:8795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787432426.994604:0:8795:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787432426.994618:0:8795:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787432426.994626:0:8795:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xca72b3b33563e990 00010000:00080000:1.0:1787432426.994655:0:8795:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9484034a7800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.124@tcp at head 00010000:00010000:1.0:1787432426.994888:0:8795:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1787432427.007382:0:8795:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787432427.007408:0:8795:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787432427.007633:0:8795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432427.007843:0:8795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432427.008149:0:8795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787432427.008467:0:8795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787432427.011989:0:8796:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787432427.011996:0:8796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787432427.021514:0:8795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787432427.021537:0:8795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787432427.021702:0:8795:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787432427.021730:0:8795:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b33563e997 00000100:00080000:3.0:1787432427.021741:0:8795:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787432427.021746:0:8795:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9484034a7800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432427.021792:0:8795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94843489d880 x1874258609333504/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432427.021824:0:8795:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787432427.021893:0:8795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432427.021898:0:8795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432427.021899:0:8795:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787432427.021902:0:8795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432427.021906:0:8795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432427.021907:0:8795:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787432427.021910:0:8795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787432427.021912:0:8795:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787432427.021940:0:8795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8795:1874258609333632:0@lo:502: 00000100:00100000:3.0:1787432427.022030:0:8795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432427.022069:0:8795:0:(client.c:2715:ptlrpc_set_wait()) set ffff948404ca8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432427.022091:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609333632 00000100:00100000:3.0:1787432427.022096:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609333632 00000100:00100000:0.0:1787432427.022099:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609333504:0@lo:8: 00000100:00100000:3.0:1787432427.022137:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787432427.022145:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432427.022150:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:8795:x1874258609333632:12345-0@lo:502: 00000100:00100000:3.0:1787432427.022283:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:8795:x1874258609333632:12345-0@lo:502: Request processed in 137us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432427.022291:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787432427.022346:0:8795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8795:1874258609333632:0@lo:502: 00000020:01000000:3.0:1787432427.022371:0:8795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432427.022375:0:8795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432427.022377:0:8795:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787432427.022380:0:8795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1787432427.022502:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1787432427.022520:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787432427.022530:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563e97b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e982 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432427.022547:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563e97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e982 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432427.022558:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787432427.022561:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948411b1c000 from 30 10000000:01000000:3.0:1787432427.022564:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787432427.023720:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563e99e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432427.023734:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563e99e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432427.023744:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563e99e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432427.023763:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609333888:0@lo:101: 00000100:00100000:3.0:1787432427.023811:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432427.024070:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484164bacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432427.025411:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609333888 00000100:00100000:2.0:1787432427.025423:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609333888 00000100:00100000:2.0:1787432427.025479:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787432427.025498:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609333888:12345-0@lo:101: 00010000:00010000:2.0:1787432427.025517:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432427.025552:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484032e4800/0xca72b3b33563e9a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e99e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432427.025584:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e4800/0xca72b3b33563e9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e99e expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432427.025596:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484032e4800/0xca72b3b33563e9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e99e expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432427.025606:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e4800, rc 0) 00000100:00100000:2.0:1787432427.025680:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609333888:12345-0@lo:101: Request processed in 183us (1867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432427.025687:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787432427.025760:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609333888:0@lo:101: 00010000:00010000:2.0:1787432427.025781:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563e99e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e9a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432427.025791:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563e99e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e9a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432427.025878:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609334016:0@lo:501: 00000100:00100000:2.0:1787432427.025924:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432427.025945:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d31b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432427.025974:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609334016 00000100:00100000:2.0:1787432427.025977:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609334016 00000100:00100000:2.0:1787432427.026003:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787432427.026010:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609334016:12345-0@lo:501: 00000100:00100000:2.0:1787432427.026140:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609334016:12345-0@lo:501: Request processed in 130us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432427.026147:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787432427.026199:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609334016:0@lo:501: 00000100:00100000:2.0:1787432427.026228:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609334144:0@lo:503: 00000100:00100000:2.0:1787432427.027817:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432427.027874:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d31b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432427.027902:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609334144 00000100:00100000:3.0:1787432427.027911:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609334144 00000100:00100000:2.0:1787432427.028244:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609333760:0@lo:400: 00000100:00100000:2.0:1787432427.028317:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432427.030133:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609334272:0@lo:400: 00000100:00100000:0.0:1787432427.030207:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432427.030257:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609333760 00000100:00100000:0.0:1787432427.030264:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609333760 00000100:00100000:0.0:1787432427.030325:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787432427.030335:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609333760:12345-0@lo:400: 00000100:00100000:0.0:1787432427.030393:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609333760:12345-0@lo:400: Request processed in 58us (2075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432427.030400:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787432427.030426:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609334272 00000100:00100000:0.0:1787432427.030429:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609334272 00000100:00100000:0.0:1787432427.030452:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787432427.030458:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609334272:12345-0@lo:400: 00000100:00100000:0.0:1787432427.030496:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609334272:12345-0@lo:400: Request processed in 38us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432427.030519:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787432427.030579:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609334272:0@lo:400: 00010000:00080000:0.0:1787432427.030615:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301e38000 x1874258609333760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432427.030627:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609333760:0@lo:400: 00000100:00100000:1.0:1787432427.038255:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609334784:0@lo:400: 00000100:00100000:1.0:1787432427.038340:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432427.038381:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432427.038388:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609334400:0@lo:400: 00000100:00100000:1.0:1787432427.038412:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432427.038441:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609334528:0@lo:400: 00000100:00100000:1.0:1787432427.038467:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432427.038487:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432427.038493:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609334656:0@lo:400: 00000100:00100000:1.0:1787432427.038517:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432427.038562:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609334784 00000100:00100000:1.0:1787432427.038569:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609334784 00000100:00100000:1.0:1787432427.038621:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609334400 00000100:00100000:1.0:1787432427.038624:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609334400 00000100:00100000:1.0:1787432427.038638:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609334656 00000100:00100000:1.0:1787432427.038640:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609334656 00000100:00100000:1.0:1787432427.038656:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787432427.038665:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609334784:12345-0@lo:400: 00000100:00100000:1.0:1787432427.038719:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609334784:12345-0@lo:400: Request processed in 54us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432427.038725:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787432427.038742:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787432427.038749:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609334400:12345-0@lo:400: 00000100:00100000:1.0:1787432427.038776:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609334400:12345-0@lo:400: Request processed in 28us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432427.038791:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787432427.038805:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787432427.038811:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609334656:12345-0@lo:400: 00000100:00100000:1.0:1787432427.038845:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609334656:12345-0@lo:400: Request processed in 35us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432427.038851:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787432427.038871:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609334528 00000100:00100000:1.0:1787432427.038875:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609334528 00000100:00100000:1.0:1787432427.038898:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787432427.038905:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609334528:12345-0@lo:400: 00000100:00100000:1.0:1787432427.038935:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609334528:12345-0@lo:400: Request processed in 31us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432427.038941:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787432427.038971:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432427.038975:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787432427.039002:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301e39c00 x1874258609334400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432427.039016:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609334400:0@lo:400: 00010000:00080000:1.0:1787432427.039025:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301e38380 x1874258609334784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432427.039033:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609334784:0@lo:400: 00010000:00080000:1.0:1787432427.039061:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301e39880 x1874258609334656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432427.039069:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609334656:0@lo:400: 00000100:00100000:1.0:1787432427.039078:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609334528:0@lo:400: 00000100:00100000:3.0:1787432427.043068:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787432427.043089:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609334144:12345-0@lo:503: 00000100:00100000:3.0:1787432427.043279:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609334144:12345-0@lo:503: Request processed in 197us (17008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432427.043287:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787432427.043372:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609334144:0@lo:503: 00000100:00100000:3.0:1787432427.043581:0:8800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8800:1874258609334912:0@lo:502: 00000100:00100000:3.0:1787432427.043631:0:8800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432427.043737:0:8800:0:(client.c:2715:ptlrpc_set_wait()) set ffff948404ca8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432427.044601:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609333504 00000100:00100000:3.0:1787432427.044609:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609333504 00000100:00100000:3.0:1787432427.044707:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432427.044718:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1874258609333504:12345-0@lo:8: 00010000:00080000:3.0:1787432427.044747:0:8430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:3.0:1787432427.044776:0:8430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b33563e9ac 00002000:00100000:3.0:1787432427.044820:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff948301e42000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787432427.044825:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1787432427.044830:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787432427.045065:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787432427.045300:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1787432427.045327:0:8430:0:(import.c:65:import_set_state_nolock()) ffff948301e46000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432427.045407:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1874258609333504:12345-0@lo:8: Request processed in 688us (23262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432427.045415:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787432427.047420:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609334912 00000100:00100000:2.0:1787432427.047432:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609334912 00000100:00100000:2.0:1787432427.047492:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787432427.047503:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:8800:x1874258609334912:12345-0@lo:502: 00000100:00100000:2.0:1787432427.048014:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:8800:x1874258609334912:12345-0@lo:502: Request processed in 510us (4381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432427.048022:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787432427.048068:0:8800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8800:1874258609334912:0@lo:502: 00000100:00100000:3.0:1787432427.048157:0:8800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8800:1874258609335040:0@lo:502: 00000100:00100000:3.0:1787432427.048237:0:8800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432427.048270:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609335040 00000100:00100000:3.0:1787432427.048274:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609335040 00000100:00100000:3.0:1787432427.048305:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787432427.048313:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:8800:x1874258609335040:12345-0@lo:502: 00000100:00100000:3.0:1787432427.048388:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:8800:x1874258609335040:12345-0@lo:502: Request processed in 76us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432427.048406:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787432427.048440:0:8800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112cf180 going to sleep for 11 seconds 00000100:00100000:3.0:1787432427.048453:0:8800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8800:1874258609335040:0@lo:502: 00000040:00080000:3.0:1787432427.048474:0:8800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787432427.048541:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787432427.048561:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787432427.048572:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563e99e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e9a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432427.048582:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563e99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e9a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432427.048592:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787432427.048595:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948411b1c000 from 5 10000000:01000000:3.0:1787432427.048598:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787432427.048624:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e9b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432427.048633:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e9b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432427.048642:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e9b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432427.048736:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609335168:0@lo:101: 00000100:00100000:3.0:1787432427.048768:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432427.048792:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112cf180 going to sleep for 11 seconds 00000100:00100000:2.0:1787432427.048799:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609335168 00000100:00100000:2.0:1787432427.048805:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609335168 00000100:00100000:2.0:1787432427.048837:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787432427.048845:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948406122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609335168:12345-0@lo:101: 00010000:00010000:2.0:1787432427.048854:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432427.048868:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484032e4c00/0xca72b3b33563e9ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e9b3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432427.051723:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e4c00/0xca72b3b33563e9ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e9b3 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432427.051763:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484032e4c00/0xca72b3b33563e9ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e9b3 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432427.051774:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e4c00, rc 0) 00000100:00100000:2.0:1787432427.051863:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948406122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:6511:x1874258609335168:12345-0@lo:101: Request processed in 3017us (3094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432427.051873:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787432427.052046:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609335168:0@lo:101: 00010000:00010000:3.0:1787432427.052081:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e9b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e9ba expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432427.052093:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e9b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e9ba expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432427.052185:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609335296:0@lo:256: 00000100:00100000:3.0:1787432427.052235:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432427.052263:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112cf180 going to sleep for 11 seconds 00000100:00100000:3.0:1787432427.052290:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609335296 00000100:00100000:3.0:1787432427.052296:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609335296 00000100:00100000:3.0:1787432427.052335:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787432427.052344:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948406120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:6511:x1874258609335296:12345-0@lo:256: 20000000:01000000:3.0:1787432427.052364:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787432427.052384:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787432427.052387:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787432427.052470:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948406120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:6511:x1874258609335296:12345-0@lo:256: Request processed in 127us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432427.052478:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787432427.052516:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609335296:0@lo:256: 10000000:01000000:3.0:1787432427.052559:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787432427.052567:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e9b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e9ba expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432427.052576:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e9b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e9ba expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432427.052586:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787432427.052594:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1787432427.052597:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787432427.052623:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e9c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432427.052631:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e9c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432427.052640:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e9c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432427.054080:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609335424:0@lo:101: 00000100:00100000:3.0:1787432427.054220:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432427.054283:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112cf180 going to sleep for 11 seconds 00000100:00100000:3.0:1787432427.054317:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609335424 00000100:00100000:3.0:1787432427.054324:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609335424 00000100:00100000:3.0:1787432427.054365:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787432427.054374:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948406122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:6511:x1874258609335424:12345-0@lo:101: 00010000:00010000:3.0:1787432427.054388:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432427.054404:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484013fcc00/0xca72b3b33563e9c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e9c1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432427.054428:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fcc00/0xca72b3b33563e9c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e9c1 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432427.054438:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484013fcc00/0xca72b3b33563e9c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e9c1 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432427.054447:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fcc00, rc 0) 00000100:00100000:3.0:1787432427.054482:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948406122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609335424:12345-0@lo:101: Request processed in 110us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432427.054497:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787432427.054541:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609335424:0@lo:101: 00010000:00010000:3.0:1787432427.054556:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e9c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e9c8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432427.054565:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e9c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e9c8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432427.054626:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609335552:0@lo:501: 00000100:00100000:3.0:1787432427.055228:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432427.055250:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112df300 going to sleep for 11 seconds 00000100:00100000:3.0:1787432427.055272:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609335552 00000100:00100000:3.0:1787432427.055276:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609335552 00000100:00100000:3.0:1787432427.055319:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787432427.055327:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609335552:12345-0@lo:501: 00000100:00100000:3.0:1787432427.055446:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609335552:12345-0@lo:501: Request processed in 119us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432427.055452:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787432427.055489:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609335552:0@lo:501: 00000100:00100000:3.0:1787432427.055523:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609335680:0@lo:503: 00000100:00100000:3.0:1787432427.055567:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432427.055581:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112df300 going to sleep for 11 seconds 00000100:00100000:3.0:1787432427.055594:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609335680 00000100:00100000:3.0:1787432427.055597:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609335680 00000100:00100000:3.0:1787432427.055619:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787432427.055625:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609335680:12345-0@lo:503: 00000100:00100000:3.0:1787432427.055725:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609335680:12345-0@lo:503: Request processed in 99us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432427.055731:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787432427.055772:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609335680:0@lo:503: 00000100:00100000:3.0:1787432427.056135:0:8802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8802:1874258609335808:0@lo:502: 00000100:00100000:3.0:1787432427.056195:0:8802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432427.056216:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609335808 00000100:00100000:3.0:1787432427.056219:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609335808 00000100:00100000:3.0:1787432427.056243:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787432427.056250:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:8802:x1874258609335808:12345-0@lo:502: 00000100:00100000:3.0:1787432427.056347:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:8802:x1874258609335808:12345-0@lo:502: Request processed in 97us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432427.056354:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787432427.056384:0:8802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112cf180 going to sleep for 11 seconds 00000100:00100000:3.0:1787432427.056398:0:8802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8802:1874258609335808:0@lo:502: 00000020:01000000:3.0:1787432427.056424:0:8802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787432427.056431:0:8802:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787432427.056438:0:8802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432427.056440:0:8802:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787432427.056445:0:8802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787432427.056448:0:8802:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.124@tcp to nid 0x20000c0a8cc7c (192.168.204.124@tcp) 00000020:01000000:3.0:1787432427.056471:0:8802:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787432427.056474:0:8802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787432427.056496:0:8802:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9483030f0000) 00000020:00000080:3.0:1787432427.056518:0:8802:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1787432427.056524:0:8802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787432427.056605:0:8802:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787432427.056615:0:8802:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787432427.056621:0:8802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33563e9d6 00010000:00080000:3.0:1787432427.056649:0:8802:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948301dd7000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.124@tcp at head 00010000:00010000:3.0:1787432427.056867:0:8802:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00010000:00080000:0.0:1787432427.057476:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94843489d880 x1874258609333504/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787432437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432427.057488:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787432427.057496:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787432427.057503:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787432427.057509:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787432427.057513:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484034a7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787432427.057547:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787432427.057554:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609333504:0@lo:8: 00000100:00100000:0.0:1787432427.057614:0:8797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302766a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8797:1874258609335936:0@lo:700: 00000100:00100000:0.0:1787432427.057661:0:8797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432427.057703:0:8797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f4480 going to sleep for 11 seconds 00000100:00100000:3.0:1787432427.057726:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609335936 00000100:00100000:3.0:1787432427.057733:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609335936 00000100:00100000:3.0:1787432427.057800:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432427.057809:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8797:x1874258609335936:12345-0@lo:700: 00000100:00080000:0.0:1787432427.057975:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432427.058059:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1874258609336064:0@lo:700: 00000100:00100000:3.0:1787432427.058093:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432427.058119:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff948302773a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432427.058754:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609336064 00000100:00100000:0.0:1787432427.058761:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609336064 00000100:00100000:0.0:1787432427.058800:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432427.058809:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1874258609336064:12345-0@lo:700: 00000004:00080000:2.0:1787432427.059148:0:8796:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787432427.059229:0:8796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 238151063443ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787432427.059236:0:8796:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1787432427.071525:0:7445:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000040:01000000:3.0:1787432427.072286:0:8802:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787432427.072308:0:8802:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787432427.072502:0:8802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787432427.072715:0:8802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787432427.072805:0:8802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787432427.072919:0:8802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 40000000:02000000:0.0:1787432427.073043:0:6520:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000040:00080000:1.0:1787432427.087250:0:8804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787432427.087259:0:8804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787432427.088257:0:8802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787432427.088272:0:8802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787432427.088311:0:8802:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787432427.088336:0:8802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b33563e9dd 00000100:00080000:2.0:1787432427.088346:0:8802:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787432427.088352:0:8802:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff948301dd7000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432427.088387:0:8802:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948301dbf100 x1874258609336192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432427.088411:0:8802:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787432427.088499:0:8802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432427.088505:0:8802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432427.088506:0:8802:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787432427.088510:0:8802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432427.088515:0:8802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432427.088517:0:8802:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787432427.088521:0:8802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787432427.088523:0:8802:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787432427.088553:0:8802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8802:1874258609336320:0@lo:502: 00000100:00100000:2.0:1787432427.088636:0:8802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432427.088686:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609336320 00000100:00100000:2.0:1787432427.088693:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609336320 00000100:00100000:2.0:1787432427.088734:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787432427.088745:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:8802:x1874258609336320:12345-0@lo:502: 00000100:00100000:2.0:1787432427.088858:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:8802:x1874258609336320:12345-0@lo:502: Request processed in 114us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432427.088866:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787432427.088916:0:8802:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d67c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432427.088937:0:8802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:8802:1874258609336320:0@lo:502: 00000020:01000000:2.0:1787432427.088971:0:8802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432427.088976:0:8802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432427.088978:0:8802:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787432427.088981:0:8802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1787432427.089029:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787432427.089047:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787432427.089057:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e9c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e9c8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432427.089069:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e9c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e9c8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432427.089080:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787432427.089083:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9484336199b8 from 1 10000000:01000000:2.0:1787432427.089086:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787432427.089110:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563e9e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432427.089118:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563e9e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432427.089135:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563e9e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432427.089150:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609336448:0@lo:101: 00000100:00100000:2.0:1787432427.089204:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432427.089227:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d67c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432427.089235:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609336448 00000100:00100000:3.0:1787432427.089241:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609336448 00000100:00100000:3.0:1787432427.089276:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787432427.089285:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609336448:12345-0@lo:101: 00010000:00010000:3.0:1787432427.089295:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432427.089319:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303013e00/0xca72b3b33563e9eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563e9e4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432427.089343:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303013e00/0xca72b3b33563e9eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563e9e4 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432427.089355:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303013e00/0xca72b3b33563e9eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e9e4 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432427.089374:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303013e00, rc 0) 00000100:00100000:3.0:1787432427.089416:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609336448:12345-0@lo:101: Request processed in 132us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432427.089423:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787432427.089501:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609336192:0@lo:8: 00000100:00100000:1.0:1787432427.089540:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432427.089574:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609336192 00000100:00100000:1.0:1787432427.089577:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609336192 00000100:00100000:1.0:1787432427.089604:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787432427.089609:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1874258609336192:12345-0@lo:8: 00010000:00080000:1.0:1787432427.089630:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1787432427.089668:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b33563e9f2 00002000:00100000:1.0:1787432427.089683:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9484166d0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787432427.089687:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787432427.089689:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787432427.089760:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787432427.089786:0:8432:0:(import.c:65:import_set_state_nolock()) ffff94843c7f1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432427.089827:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1874258609336192:12345-0@lo:8: Request processed in 216us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432427.089835:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787432427.089865:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbf100 x1874258609336192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787432437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432427.089875:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787432427.089882:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787432427.089889:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787432427.089894:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787432427.089896:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948301dd7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787432427.089905:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787432427.089940:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609336192:0@lo:8: 00000004:00080000:1.0:1787432427.090075:0:8804:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787432427.090121:0:8804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 238181956328ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787432427.090127:0:8804:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787432427.093193:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609336448:0@lo:101: 00010000:00010000:2.0:1787432427.093227:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563e9e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e9eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432427.093242:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563e9e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e9eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432427.093372:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609336576:0@lo:501: 00000100:00100000:3.0:1787432427.093443:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432427.093481:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948302773900 going to sleep for 11 seconds 00000100:00100000:2.0:1787432427.096150:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609336576 00000100:00100000:2.0:1787432427.096180:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609336576 00000100:00100000:2.0:1787432427.096261:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787432427.096273:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609336576:12345-0@lo:501: 00000100:00100000:2.0:1787432427.096410:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609336576:12345-0@lo:501: Request processed in 139us (2968us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787432427.096419:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787432427.096561:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609336576:0@lo:501: 10000000:01000000:3.0:1787432427.096609:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787432427.096619:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563e9e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e9eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432427.096629:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563e9e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e9eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432427.100866:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1874258609336064:12345-0@lo:700: Request processed in 42050us (42763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432427.100880:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787432427.101016:0:8438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94843489e680 x1874258609336064/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787432443 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432427.101033:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1874258609336064:0@lo:700: 40000000:02000000:3.0:1787432427.101047:0:8438:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000001:02000400:1.0:1787432427.106026:0:8803:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000004:00080000:0.0:1787432427.109827:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000001:00100000:3.0:1787432427.117152:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787432427.117182:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000004:00080000:0.0:1787432427.117264:0:8805:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787432427.117293:0:8805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302766d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8805:1874258609336832:0@lo:7: 00000100:00100000:0.0:1787432427.117364:0:8805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432427.117390:0:8805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432427.117513:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8797:x1874258609335936:12345-0@lo:700: Request processed in 59703us (59849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432427.117526:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787432427.118067:0:8797:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948302766a00 x1874258609335936/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787432443 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432427.118082:0:8797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302766a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8797:1874258609335936:0@lo:700: 00000100:00100000:2.0:1787432427.120267:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432427.120294:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609336704:0@lo:13: 00000100:00100000:2.0:1787432427.120369:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432427.120484:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609336704 00000100:00100000:0.0:1787432427.120493:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609336704 00000100:00100000:0.0:1787432427.120561:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432427.120570:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609336832 00000100:00100000:0.0:1787432427.120572:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609336704:12345-0@lo:13: 00000100:00100000:3.0:1787432427.120577:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609336832 00002000:00000024:0.0:1787432427.120604:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1787432427.120617:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787432427.120626:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8805:x1874258609336832:12345-0@lo:7: 00000100:00100000:0.0:1787432427.120654:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1874258609336704:12345-0@lo:13: Request processed in 83us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432427.120662:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787432427.120699:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948302764000 x1874258609336704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432427.120718:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609336704:0@lo:13: 00000100:00080000:2.0:1787432427.120781:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432427.130191:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432427.130216:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609336960:0@lo:13: 00000100:00100000:1.0:1787432427.130293:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432427.130370:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609336960 00000100:00100000:1.0:1787432427.130377:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609336960 00000100:00100000:1.0:1787432427.130431:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787432427.130440:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609336960:12345-0@lo:13: 00002000:00000024:1.0:1787432427.130462:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1787432427.130506:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609336960:12345-0@lo:13: Request processed in 67us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432427.130513:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787432427.130633:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301e39880 x1874258609336960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432427.130654:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609336960:0@lo:13: 00000004:00080000:1.0:1787432427.130676:0:8797:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787432427.130697:0:8797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e39880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8797:1874258609337088:0@lo:7: 00000100:00100000:1.0:1787432427.130724:0:8797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432427.130750:0:8797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484115d16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432427.130773:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787432427.130782:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787432427.131742:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609337088 00000100:00100000:1.0:1787432427.131750:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609337088 00000100:00100000:2.0:1787432427.131975:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787432427.131986:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8797:x1874258609337088:12345-0@lo:7: 00002000:00080000:3.0:1787432427.146373:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787432427.146383:0:8431:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787432427.146484:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8805:x1874258609336832:12345-0@lo:7: Request processed in 25855us (29116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432427.146495:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787432427.149243:0:8805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948302766d80 x1874258609336832/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787432443 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432427.149274:0:8805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302766d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8805:1874258609336832:0@lo:7: 00000004:00080000:0.0:1787432427.149291:0:8805:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787432427.149336:0:8805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302766d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8805:1874258609337216:0@lo:5: 00000100:00100000:0.0:1787432427.149397:0:8805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432427.149441:0:8805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432427.151043:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609337216 00000100:00100000:3.0:1787432427.151058:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609337216 00000100:00100000:3.0:1787432427.151124:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787432427.151136:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8805:x1874258609337216:12345-0@lo:5: 00002000:00080000:3.0:1787432427.151186:0:8432:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787432427.151190:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787432427.165574:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8805:x1874258609337216:12345-0@lo:5: Request processed in 14435us (16171us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787432427.165587:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787432427.165807:0:8805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948302766d80 x1874258609337216/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787432443 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432427.165825:0:8805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302766d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8805:1874258609337216:0@lo:5: 00000004:00080000:2.0:1787432427.165838:0:8805:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787432427.165880:0:8805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8805:1874258609337344:0@lo:700: 00000100:00100000:2.0:1787432427.165931:0:8805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432427.165971:0:8805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112df300 going to sleep for 11 seconds 00000100:00100000:3.0:1787432427.166072:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609337344 00000100:00100000:3.0:1787432427.166078:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609337344 00000100:00100000:3.0:1787432427.166123:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787432427.166133:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8805:x1874258609337344:12345-0@lo:700: 00002000:00080000:0.0:1787432427.171202:0:8806:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787432427.171213:0:8806:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787432427.171304:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8797:x1874258609337088:12345-0@lo:7: Request processed in 39316us (40575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432427.171332:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787432427.171435:0:8797:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301e39880 x1874258609337088/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787432443 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432427.171449:0:8797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e39880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8797:1874258609337088:0@lo:7: 00000004:00080000:2.0:1787432427.171462:0:8797:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787432427.171495:0:8797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8797:1874258609337472:0@lo:5: 00000100:00100000:2.0:1787432427.171542:0:8797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432427.171581:0:8797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112df780 going to sleep for 11 seconds 00000100:00100000:0.0:1787432427.171725:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609337472 00000100:00100000:0.0:1787432427.171732:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609337472 00000100:00100000:0.0:1787432427.171775:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432427.171784:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8797:x1874258609337472:12345-0@lo:5: 00002000:00080000:0.0:1787432427.171809:0:8431:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1787432427.171840:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8797:x1874258609337472:12345-0@lo:5: Request processed in 57us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432427.171845:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787432427.171867:0:8797:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbd180 x1874258609337472/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787432443 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432427.171876:0:8797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8797:1874258609337472:0@lo:5: 00000004:00080000:0.0:1787432427.171884:0:8797:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787432427.171921:0:8797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302766a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8797:1874258609337600:0@lo:5: 00000100:00100000:0.0:1787432427.171941:0:8797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432427.171968:0:8797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f4480 going to sleep for 11 seconds 00000100:00100000:0.0:1787432427.171978:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609337600 00000100:00100000:0.0:1787432427.171980:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609337600 00000100:00100000:0.0:1787432427.171998:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787432427.172003:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8797:x1874258609337600:12345-0@lo:5: 00002000:00080000:0.0:1787432427.172023:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000001:00080000:3.0:1787432427.175962:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1787432427.176092:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8805:x1874258609337344:12345-0@lo:700: Request processed in 9956us (10157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432427.176106:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787432427.176193:0:8805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbc700 x1874258609337344/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787432443 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432427.176206:0:8805:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787432427.176227:0:8805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8805:1874258609337344:0@lo:700: 00000004:02000040:2.0:1787432427.180709:0:8805:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1787432427.183687:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8797:x1874258609337600:12345-0@lo:5: Request processed in 11675us (11736us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787432427.183709:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787432427.183768:0:8797:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948302766a00 x1874258609337600/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787432443 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432427.191203:0:8797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302766a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8797:1874258609337600:0@lo:5: 00000004:00080000:0.0:1787432427.191227:0:8797:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1787432427.191284:0:8797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8797:1874258609337728:0@lo:900: 00000100:00100000:0.0:1787432427.191349:0:8797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432427.191385:0:8797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f4480 going to sleep for 11 seconds 00000100:00100000:0.0:1787432427.191422:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609337728 00000100:00100000:0.0:1787432427.191430:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609337728 00000100:00100000:0.0:1787432427.191478:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432427.191489:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8797:x1874258609337728:12345-0@lo:900: 00000100:00100000:3.0:1787432427.195902:0:8805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8805:1874258609337856:0@lo:5: 00000100:00100000:3.0:1787432427.196003:0:8805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432427.196047:0:8805:0:(client.c:2715:ptlrpc_set_wait()) set ffff948302773f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432427.196144:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609337856 00000100:00100000:2.0:1787432427.196152:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609337856 00000100:00100000:2.0:1787432427.196264:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787432427.196611:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8805:x1874258609337856:12345-0@lo:5: 00000100:00100000:0.0:1787432427.199115:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8797:x1874258609337728:12345-0@lo:900: Request processed in 1275us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432427.199143:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787432427.199704:0:8797:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948302765880 x1874258609337728/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787432443 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432427.199731:0:8797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8797:1874258609337728:0@lo:900: 00002000:00080000:2.0:1787432427.204023:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787432427.204044:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1787432427.206772:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8805:x1874258609337856:12345-0@lo:5: Request processed in 10160us (10762us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787432427.206788:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787432427.206865:0:8805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94843489e680 x1874258609337856/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787432443 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432427.206881:0:8805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8805:1874258609337856:0@lo:5: 00000004:00080000:0.0:1787432427.207001:0:8805:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:3.0:1787432427.471270:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432427.471301:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609337984:0@lo:41: 00000100:00100000:3.0:1787432427.471371:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432427.471437:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609337984 00000100:00100000:3.0:1787432427.471446:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609337984 00000100:00100000:3.0:1787432427.471497:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787432427.471507:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609337984:12345-0@lo:41: 00000004:00000024:3.0:1787432427.471545:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1787432427.471585:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609337984:12345-0@lo:41: Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432427.471591:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787432427.471629:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609337984:0@lo:41: 00010000:00010000:1.0:1787432427.725005:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787432428.309531:0:8858:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787432428.309904:0:8858:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787432428.752125:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787432429.263650:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:3.0:1787432429.263673:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:1.0:1787432429.515628:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432429.515656:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609338112:0@lo:41: 00000100:00100000:1.0:1787432429.515734:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432429.516111:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609338112 00000100:00100000:0.0:1787432429.516121:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609338112 00000100:00100000:0.0:1787432429.516257:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787432429.516269:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609338112:12345-0@lo:41: 00000004:00000024:0.0:1787432429.516309:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787432429.516375:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609338112:12345-0@lo:41: Request processed in 108us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432429.516396:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787432429.516529:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609338112:0@lo:41: 00010000:00010000:1.0:1787432429.771459:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432430.807155:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787432431.325988:0:8960:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787432431.326268:0:8960:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787432431.827944:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787432432.266353:0:9008:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787432432.266365:0:9008:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1787432432.587335:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432432.587335:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432432.587363:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609338240:0@lo:41: 00000100:00100000:1.0:1787432432.587375:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609338368:0@lo:13: 00000100:00100000:0.0:1787432432.587490:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432432.587500:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609338496:0@lo:13: 00000100:00100000:2.0:1787432432.587777:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609338752:0@lo:400: 00000100:00100000:1.0:1787432432.588008:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432432.588066:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609339008:0@lo:400: 00000100:00100000:1.0:1787432432.588094:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432432.588111:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609339520:0@lo:400: 00000100:00100000:1.0:1787432432.588133:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432432.588150:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787432432.588155:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609338880:0@lo:400: 00000100:00100000:1.0:1787432432.588202:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432432.588219:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609339392:0@lo:400: 00000100:00100000:1.0:1787432432.588239:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432432.588270:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609338368 00000100:00100000:1.0:1787432432.588281:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609338368 00000100:00100000:1.0:1787432432.589078:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432432.589089:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609338368:12345-0@lo:13: 00000100:00100000:0.0:1787432432.589113:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787432432.589138:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432432.589178:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609338880 00000100:00100000:0.0:1787432432.589183:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609338880 00000100:00100000:1.0:1787432432.589199:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609338368:12345-0@lo:13: Request processed in 113us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432432.589206:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432432.589214:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787432432.589219:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609338496 00000100:00100000:0.0:1787432432.589220:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609338880:12345-0@lo:400: 00000100:00100000:1.0:1787432432.589222:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609338496 00000100:00100000:1.0:1787432432.589236:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787432432.589241:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609338496:12345-0@lo:13: 00002000:00000024:1.0:1787432432.589250:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432432.589254:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609338880:12345-0@lo:400: Request processed in 34us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432432.589260:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787432432.589275:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609338496:12345-0@lo:13: Request processed in 34us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432432.589280:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432432.589290:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609339520 00000100:00100000:0.0:1787432432.589293:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609339520 00000100:00100000:1.0:1787432432.589307:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609339008 00000100:00100000:1.0:1787432432.589310:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609339008 00000100:00100000:0.0:1787432432.589317:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432432.589323:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609339520:12345-0@lo:400: 00000100:00100000:1.0:1787432432.589328:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609339392 00000100:00100000:1.0:1787432432.589331:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609339392 00000100:00100000:1.0:1787432432.589346:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787432432.589351:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609339520:12345-0@lo:400: Request processed in 28us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432432.589352:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609339008:12345-0@lo:400: 00000100:00100000:0.0:1787432432.589357:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432432.589375:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787432432.589382:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787432432.589493:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787432432.589500:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609339392:12345-0@lo:400: 00000100:00100000:0.0:1787432432.589721:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609339392:12345-0@lo:400: Request processed in 220us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432432.589728:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787432432.589904:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432432.589938:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609338624:0@lo:400: 00000100:00100000:3.0:1787432432.589969:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432432.589995:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609339136:0@lo:400: 00000100:00100000:3.0:1787432432.590015:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432432.590032:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609339648:0@lo:400: 00000100:00100000:3.0:1787432432.590053:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432432.590087:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609339008:12345-0@lo:400: Request processed in 734us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432432.590095:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787432432.590105:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609338240 00000100:00100000:3.0:1787432432.590110:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609338240 00000100:00100000:1.0:1787432432.590116:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609339648 00000100:00100000:1.0:1787432432.590119:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609339648 00000100:00100000:3.0:1787432432.590128:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609339136 00000100:00100000:3.0:1787432432.590130:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609339136 00000100:00100000:1.0:1787432432.590141:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787432432.590142:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787432432.590147:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609338240:12345-0@lo:41: 00000100:00100000:1.0:1787432432.590147:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609339648:12345-0@lo:400: 00000004:00000024:3.0:1787432432.590193:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787432432.590197:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609339648:12345-0@lo:400: Request processed in 50us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432432.590203:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787432432.590225:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609338240:12345-0@lo:41: Request processed in 77us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432432.590230:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787432432.590243:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787432432.590249:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609339136:12345-0@lo:400: 00010000:00080000:1.0:1787432432.590250:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948302767b80 x1874258609338496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432432.590261:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1787432432.590271:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609339136:12345-0@lo:400: Request processed in 24us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432432.590276:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787432432.590287:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609338496:0@lo:13: 00000100:00100000:3.0:1787432432.590296:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609338624 00000100:00100000:3.0:1787432432.590299:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609338624 00000100:00100000:3.0:1787432432.590325:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787432432.590332:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405079c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:3643:x1874258609338624:12345-0@lo:400: 00000100:00100000:3.0:1787432432.590359:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405079c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:3643:x1874258609338624:12345-0@lo:400: Request processed in 28us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432432.590365:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787432432.590402:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609338624:0@lo:400: 00000100:00100000:3.0:1787432432.590414:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609339136:0@lo:400: 00010000:00080000:3.0:1787432432.590422:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbce00 x1874258609339648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432432.590431:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609339648:0@lo:400: 00000100:00100000:1.0:1787432432.590442:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609338880:0@lo:400: 00000100:00100000:3.0:1787432432.590449:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609338240:0@lo:41: 00010000:00080000:1.0:1787432432.590453:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbf800 x1874258609339392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432432.590461:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609339392:0@lo:400: 00010000:00080000:1.0:1787432432.590470:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbc000 x1874258609339008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432432.590477:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609339008:0@lo:400: 00010000:00080000:1.0:1787432432.590487:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbc380 x1874258609339520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787432432.590490:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432432.590494:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00080000:3.0:1787432432.590495:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432432.590502:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609339520:0@lo:400: 00010000:00080000:1.0:1787432432.590511:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301e39f80 x1874258609338368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432432.590523:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609338368:0@lo:13: 00000100:00100000:2.0:1787432432.590933:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432432.590963:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609339264:0@lo:400: 00000100:00100000:2.0:1787432432.590987:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432432.591181:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609338752 00000100:00100000:0.0:1787432432.591186:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609338752 00000100:00100000:0.0:1787432432.591228:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609339264 00000100:00100000:0.0:1787432432.591231:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609339264 00000100:00100000:0.0:1787432432.591266:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787432432.591273:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609338752:12345-0@lo:400: 00000100:00100000:0.0:1787432432.591314:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609338752:12345-0@lo:400: Request processed in 41us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432432.591320:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787432432.591335:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787432432.591342:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609339264:12345-0@lo:400: 00000100:00100000:0.0:1787432432.591368:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609339264:12345-0@lo:400: Request processed in 27us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432432.591374:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787432432.591452:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbd180 x1874258609338752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432432.591463:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609338752:0@lo:400: 00010000:00080000:2.0:1787432432.591474:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbdc00 x1874258609339264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432432.591482:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609339264:0@lo:400: 00000100:00080000:3.0:1787432432.591597:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787432432.843307:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432433.868784:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432434.637090:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609339776:0@lo:41: 00000100:00100000:2.0:1787432434.637187:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432434.637392:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609339776 00000100:00100000:2.0:1787432434.637400:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609339776 00000100:00100000:2.0:1787432434.637464:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787432434.637474:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609339776:12345-0@lo:41: 00000004:00000024:2.0:1787432434.637505:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787432434.637549:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609339776:12345-0@lo:41: Request processed in 77us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432434.637556:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787432434.637607:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609339776:0@lo:41: 00010000:00010000:3.0:1787432434.891307:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432435.922986:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432436.946181:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432437.707754:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432437.707780:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609339904:0@lo:13: 00000100:00100000:3.0:1787432437.707858:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432437.708054:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609339904 00000100:00100000:3.0:1787432437.708113:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609340032:0@lo:41: 00000100:00100000:3.0:1787432437.708145:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432437.708265:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609339904 00000100:00100000:1.0:1787432437.708327:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787432437.708331:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609340032 00000100:00100000:3.0:1787432437.708337:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609340032 00000100:00100000:1.0:1787432437.708340:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609339904:12345-0@lo:13: 00000100:00100000:3.0:1787432437.708375:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00002000:00000024:1.0:1787432437.708375:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432437.708384:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609340032:12345-0@lo:41: 00000004:00000024:3.0:1787432437.708622:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787432437.708670:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609339904:12345-0@lo:13: Request processed in 333us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432437.708678:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787432437.708699:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432437.709036:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609340544:0@lo:400: 00000100:00100000:2.0:1787432437.709349:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609340160:0@lo:400: 00000100:00100000:0.0:1787432437.710479:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609340288:0@lo:400: 00000100:00100000:3.0:1787432437.713718:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609340032:12345-0@lo:41: Request processed in 5325us (5561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432437.713734:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787432437.717110:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432437.717262:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609340544 00000100:00100000:3.0:1787432437.717270:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609340544 00000100:00100000:3.0:1787432437.717377:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787432437.717381:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609340032:0@lo:41: 00010000:00080000:1.0:1787432437.717406:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301e3aa00 x1874258609339904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432437.717407:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609340544:12345-0@lo:400: 00000100:00100000:3.0:1787432437.717473:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609340544:12345-0@lo:400: Request processed in 86us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432437.717481:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787432437.717552:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609339904:0@lo:13: 00000100:00100000:1.0:1787432437.717586:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609341056:0@lo:13: 00000100:00100000:1.0:1787432437.717627:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432437.717656:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609340544:0@lo:400: 00000100:00100000:1.0:1787432437.717670:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787432437.717676:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609340416:0@lo:400: 00000100:00100000:1.0:1787432437.717702:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432437.717722:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609340928:0@lo:400: 00000100:00100000:1.0:1787432437.721899:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432437.721977:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609340416 00000100:00100000:1.0:1787432437.721986:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609340416 00000100:00100000:1.0:1787432437.722047:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787432437.722060:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609340416:12345-0@lo:400: 00000100:00100000:1.0:1787432437.722130:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609340416:12345-0@lo:400: Request processed in 73us (4426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432437.722137:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787432437.722226:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301e39f80 x1874258609340416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432437.722254:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609340416:0@lo:400: 00000100:00100000:1.0:1787432437.722271:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609341056 00000100:00100000:1.0:1787432437.722277:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609341056 00000100:00100000:1.0:1787432437.722328:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787432437.722335:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609341056:12345-0@lo:13: 00002000:00000024:1.0:1787432437.722350:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787432437.722380:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432437.722392:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609341056:12345-0@lo:13: Request processed in 57us (4764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432437.722398:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787432437.722424:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948302767100 x1874258609341056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432437.722441:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609341056:0@lo:13: 00000100:00100000:3.0:1787432437.722954:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609340928 00000100:00100000:3.0:1787432437.722960:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609340928 00000100:00100000:3.0:1787432437.723000:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787432437.723008:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609340928:12345-0@lo:400: 00000100:00100000:3.0:1787432437.723049:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609340928:12345-0@lo:400: Request processed in 43us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432437.723056:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787432437.723092:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948435baaa00 x1874258609340928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432437.723103:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609340928:0@lo:400: 00000100:00100000:3.0:1787432437.723130:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432437.723349:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609340672:0@lo:400: 00000100:00100000:3.0:1787432437.723382:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432437.725401:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609340672 00000100:00100000:0.0:1787432437.725415:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609340672 00000100:00100000:2.0:1787432437.725551:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609340160 00000100:00100000:2.0:1787432437.725558:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609340160 00000100:00100000:0.0:1787432437.725588:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787432437.725600:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609340672:12345-0@lo:400: 00000100:00100000:2.0:1787432437.725607:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787432437.725618:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840507ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:3643:x1874258609340160:12345-0@lo:400: 00000100:00080000:1.0:1787432437.725815:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432437.728609:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609340160:0@lo:400: 00010000:00080000:3.0:1787432437.728634:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9484348ddf80 x1874258609340672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432437.728647:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609340672:0@lo:400: 00000100:00100000:2.0:1787432437.729107:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840507ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:3643:x1874258609340160:12345-0@lo:400: Request processed in 3488us (5973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432437.729138:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787432437.729306:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609340672:12345-0@lo:400: Request processed in 3707us (5921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432437.729317:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787432437.730664:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432437.730713:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609340800:0@lo:400: 00000100:00100000:0.0:1787432437.730844:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609340288 00000100:00100000:0.0:1787432437.730852:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609340288 00000100:00100000:0.0:1787432437.730905:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787432437.730914:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609340288:12345-0@lo:400: 00000100:00100000:0.0:1787432437.730978:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609340288:12345-0@lo:400: Request processed in 64us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432437.730986:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787432437.731072:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787432437.731119:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301e3a680 x1874258609340288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432437.731127:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609340800 00000100:00100000:2.0:1787432437.731133:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609340800 00000100:00100000:1.0:1787432437.731134:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609340288:0@lo:400: 00000100:00100000:2.0:1787432437.731204:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787432437.731213:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609340800:12345-0@lo:400: 00000100:00100000:2.0:1787432437.731333:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609340800:12345-0@lo:400: Request processed in 121us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432437.731340:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787432437.731819:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787432437.731891:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9484348ddc00 x1874258609340800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432437.731903:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609340800:0@lo:400: 00010000:00010000:3.0:1787432437.964278:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432438.987597:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432439.756019:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609341184:0@lo:41: 00000100:00100000:0.0:1787432439.756093:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432439.756548:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609341184 00000100:00100000:1.0:1787432439.756560:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609341184 00000100:00100000:1.0:1787432439.756618:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787432439.756646:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609341184:12345-0@lo:41: 00000004:00000024:1.0:1787432439.756911:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787432439.756977:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609341184:12345-0@lo:41: Request processed in 340us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432439.756985:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787432439.757127:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609341184:0@lo:41: 00010000:00010000:3.0:1787432440.011323:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432441.044874:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432442.059404:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432442.828550:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432442.828584:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609341312:0@lo:13: 00000100:00100000:0.0:1787432442.828677:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432442.829422:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609341312 00000100:00100000:1.0:1787432442.829431:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609341312 00000100:00100000:1.0:1787432442.829490:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787432442.829500:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609341312:12345-0@lo:13: 00002000:00000024:1.0:1787432442.829532:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432442.829587:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609341312:12345-0@lo:13: Request processed in 89us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432442.829594:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787432442.829624:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609341440:0@lo:400: 00000100:00100000:1.0:1787432442.829671:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432442.829700:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609341952:0@lo:400: 00000100:00100000:1.0:1787432442.829727:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432442.829749:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787432442.829754:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609341568:0@lo:400: 00000100:00100000:1.0:1787432442.829778:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432442.829796:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609342080:0@lo:400: 00000100:00100000:1.0:1787432442.829831:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432442.829860:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609341696:0@lo:400: 00000100:00100000:1.0:1787432442.829883:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432442.829901:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609342208:0@lo:400: 00000100:00100000:1.0:1787432442.829921:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787432442.829956:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948302764700 x1874258609341312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432442.829975:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609341312:0@lo:13: 00000100:00100000:1.0:1787432442.829995:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787432442.830000:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609341824:0@lo:400: 00000100:00100000:1.0:1787432442.830035:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432442.830051:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609342336:0@lo:400: 00000100:00100000:1.0:1787432442.830070:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787432442.830106:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432442.830122:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609341440 00000100:00100000:1.0:1787432442.830126:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609341440 00000100:00100000:1.0:1787432442.830157:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787432442.830181:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:3641:x1874258609341440:12345-0@lo:400: 00000100:00100000:1.0:1787432442.830219:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:3641:x1874258609341440:12345-0@lo:400: Request processed in 55us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432442.830226:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787432442.830253:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609341952 00000100:00100000:1.0:1787432442.830257:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609341952 00000100:00100000:1.0:1787432442.830280:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609341696 00000100:00100000:1.0:1787432442.830283:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609341696 00000100:00100000:1.0:1787432442.830296:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787432442.830302:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609341952:12345-0@lo:400: 00000100:00100000:1.0:1787432442.830335:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609341952:12345-0@lo:400: Request processed in 33us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432442.830341:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787432442.830353:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787432442.830359:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609341696:12345-0@lo:400: 00000100:00100000:1.0:1787432442.830391:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609341696:12345-0@lo:400: Request processed in 32us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432442.830396:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787432442.830413:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609341568 00000100:00100000:1.0:1787432442.830416:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609341568 00000100:00100000:1.0:1787432442.830441:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609342080 00000100:00100000:1.0:1787432442.830445:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609342080 00000100:00100000:1.0:1787432442.830465:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609342208 00000100:00100000:1.0:1787432442.830467:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609342208 00000100:00100000:1.0:1787432442.830480:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609341824 00000100:00100000:1.0:1787432442.830482:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609341824 00000100:00100000:1.0:1787432442.830495:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787432442.830501:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609341568:12345-0@lo:400: 00000100:00100000:1.0:1787432442.830532:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609341568:12345-0@lo:400: Request processed in 30us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432442.830538:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787432442.830550:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787432442.830556:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609342080:12345-0@lo:400: 00000100:00100000:1.0:1787432442.830579:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609342080:12345-0@lo:400: Request processed in 24us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432442.830584:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787432442.830595:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787432442.830601:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609342208:12345-0@lo:400: 00000100:00100000:1.0:1787432442.830626:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609342208:12345-0@lo:400: Request processed in 26us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432442.830632:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787432442.830655:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787432442.830661:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609341824:12345-0@lo:400: 00000100:00100000:1.0:1787432442.830687:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609341824:12345-0@lo:400: Request processed in 26us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432442.830692:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787432442.830719:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609342336 00000100:00100000:1.0:1787432442.830728:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609342336 00000100:00100000:1.0:1787432442.830757:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787432442.830765:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609342336:12345-0@lo:400: 00000100:00100000:1.0:1787432442.830795:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609342336:12345-0@lo:400: Request processed in 32us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432442.830801:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787432442.830833:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948435ba8e00 x1874258609341568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432442.830844:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609341568:0@lo:400: 00010000:00080000:1.0:1787432442.830856:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948435ba9f80 x1874258609342080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432442.830864:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609342080:0@lo:400: 00000100:00100000:1.0:1787432442.830872:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609341440:0@lo:400: 00000100:00100000:1.0:1787432442.830881:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609341952:0@lo:400: 00010000:00080000:1.0:1787432442.830916:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948435ba8a80 x1874258609341824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432442.830924:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609341824:0@lo:400: 00010000:00080000:1.0:1787432442.830933:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948435ba9500 x1874258609342336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432442.830941:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609342336:0@lo:400: 00000100:00100000:1.0:1787432442.830951:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609341696:0@lo:400: 00010000:00080000:1.0:1787432442.830960:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948435ba9180 x1874258609342208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432442.830977:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609342208:0@lo:400: 00000100:00080000:1.0:1787432442.830995:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787432442.830999:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432442.831001:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432442.834289:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609342592:0@lo:13: 00000100:00100000:2.0:1787432442.834380:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432442.834411:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609342464:0@lo:41: 00000100:00100000:3.0:1787432442.834445:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432442.834446:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609342592 00000100:00100000:2.0:1787432442.834453:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609342592 00000100:00100000:3.0:1787432442.834475:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609342464 00000100:00100000:3.0:1787432442.834478:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609342464 00000100:00100000:2.0:1787432442.834496:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432442.834498:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787432442.834504:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609342592:12345-0@lo:13: 00000100:00100000:3.0:1787432442.834505:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609342464:12345-0@lo:41: 00002000:00000024:2.0:1787432442.834524:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000004:00000024:3.0:1787432442.834531:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1787432442.834564:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609342464:12345-0@lo:41: Request processed in 59us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432442.834564:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609342592:12345-0@lo:13: Request processed in 60us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432442.834571:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432442.834576:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787432442.834616:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbc000 x1874258609342592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432442.834635:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609342592:0@lo:13: 00000100:00100000:3.0:1787432442.835002:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609342464:0@lo:41: 00000020:01000004:1.0:1787432442.991067:0:9508:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787432442.991071:0:9508:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787432442.991072:0:9508:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787432442.991267:0:9508:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff948435bcb800 00000020:01000004:1.0:1787432442.991287:0:9508:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787432442.991303:0:9508:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787432442.991327:0:9508:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9483031a99b8) 00000020:00000080:1.0:1787432442.991347:0:9508:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787432443.044100:0:9508:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787432443.044402:0:9508:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1787432443.066930:0:9508:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787432443.067622:0:9508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787432443.067648:0:9508:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787432443.067672:0:9508:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xca72b3b33563ea00 00000020:01000004:2.0:1787432443.067679:0:9508:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787432443.067702:0:9508:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.124@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787432443.067705:0:9508:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787432443.067712:0:9508:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787432443.067740:0:9508:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787432443.067744:0:9508:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.124@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:3.0:1787432443.083372:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787432443.090540:0:9508:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.124@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787432443.090583:0:9508:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.124@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787432443.090588:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787432443.090590:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787432443.090591:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432443.090592:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432443.090593:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432443.090594:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432443.090596:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787432443.090598:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787432443.090599:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787432443.090601:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432443.090602:0:9508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787432443.090606:0:9508:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787432443.090608:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787432443.090609:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787432443.090610:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432443.090611:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432443.090612:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432443.090613:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432443.090614:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787432443.090615:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787432443.090616:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787432443.090617:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432443.090618:0:9508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787432443.090667:0:9508:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787432443.090687:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609342720:0@lo:253: 00000100:00100000:2.0:1787432443.090755:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432443.090813:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609342720 00000100:00100000:2.0:1787432443.090824:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609342720 00000100:00100000:2.0:1787432443.090872:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787432443.090882:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840507a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:9508:x1874258609342720:12345-0@lo:253: 20000000:01000000:2.0:1787432443.090910:0:6508:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787432443.090914:0:6508:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787432443.090919:0:6508:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787432443.090923:0:6508:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1787432443.091118:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432443.091274:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1787432443.091293:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1787432443.091311:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1787432443.091317:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1787432443.091330:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1787432443.091343:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1787432443.091429:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1787432443.091446:0:6508:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.124@tcp 20000000:01000000:2.0:1787432443.091448:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.124@tcp (null) (null) (null) 00000040:00080000:2.0:1787432443.091462:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1787432443.091469:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787432443.091482:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1787432443.091488:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.124@tcp (null) (null) 00000040:00080000:2.0:1787432443.091503:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1787432443.091510:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787432443.091523:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1787432443.091537:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1787432443.091608:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 00000100:00100000:3.0:1787432443.092384:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483026db480 going to sleep for 11 seconds 20000000:01000000:2.0:1787432443.092485:0:6508:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.124@tcp 20000000:01000000:2.0:1787432443.092488:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.124@tcp (null) (null) (null) 00000040:00080000:2.0:1787432443.092512:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1787432443.092519:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787432443.092531:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1787432443.092547:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.124@tcp (null) (null) 00000040:00080000:2.0:1787432443.092560:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1787432443.092565:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787432443.092575:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1787432443.092604:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1787432443.096820:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1787432443.096867:0:6508:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.124@tcp 20000000:01000000:2.0:1787432443.096870:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.124@tcp (null) (null) (null) 00000040:00080000:2.0:1787432443.096887:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1787432443.096895:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787432443.096907:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1787432443.096913:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.124@tcp (null) (null) 00000040:00080000:2.0:1787432443.096926:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1787432443.096933:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787432443.096946:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1787432443.096961:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1787432443.096976:0:6508:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787432443.096979:0:6508:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787432443.096983:0:6508:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787432443.097056:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787432443.097059:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787432443.098298:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1787432443.098335:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1787432443.098352:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1787432443.098949:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1787432443.098976:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1787432443.098992:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1787432443.099006:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787432443.099008:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787432443.104871:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1787432443.104925:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1787432443.104942:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1787432443.105262:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1787432443.105287:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1787432443.105304:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1787432443.105317:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787432443.105320:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787432443.106071:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1787432443.106107:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1787432443.106120:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787432443.111065:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787432443.111103:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1787432443.111120:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1787432443.111132:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787432443.111135:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787432443.115124:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1787432443.115284:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1787432443.115304:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1787432443.115572:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1787432443.115592:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1787432443.115606:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1787432443.115616:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787432443.115618:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787432443.116928:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1787432443.117145:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1787432443.117355:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1787432443.123400:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:2.0:1787432443.123450:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787432443.123473:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9484032e5600/0xca72b3b33563ea07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.123492:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484032e5400/0xca72b3b33563e8fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e8f6 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.123500:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948400030c00/0xca72b3b33563e927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e920 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.123507:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484013fc800/0xca72b3b33563e966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e95f expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.123513:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484032e5200/0xca72b3b33563e982 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e97b expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.123519:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484032e4800/0xca72b3b33563e9a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e99e expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.123526:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484013fcc00/0xca72b3b33563e9c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e9c1 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.123532:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948303013e00/0xca72b3b33563e9eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e9e4 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.123540:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9484032e5600/0xca72b3b33563ea07 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.123582:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948303013e00/0xca72b3b33563e9eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e9e4 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.123615:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948303013e00/0xca72b3b33563e9eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e9e4 expref: 21 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432443.123631:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609342848:0@lo:104: 00000100:00100000:2.0:1787432443.123809:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432443.123917:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484013fcc00/0xca72b3b33563e9c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e9c1 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.123926:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9484013fcc00/0xca72b3b33563e9c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e9c1 expref: 21 pid: 6507 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432443.123935:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609342976:0@lo:104: 00000100:00100000:2.0:1787432443.123959:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432443.132070:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484032e4800/0xca72b3b33563e9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e99e expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.132092:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9484032e4800/0xca72b3b33563e9a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e99e expref: 21 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432443.132107:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609343104:0@lo:104: 00000100:00100000:2.0:1787432443.132191:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432443.135442:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609342848 00000100:00100000:3.0:1787432443.135460:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609342848 00000100:00100000:3.0:1787432443.135552:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609342976 00000100:00100000:3.0:1787432443.135556:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609342976 00000100:00100000:3.0:1787432443.135573:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787432443.135583:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6508:x1874258609342848:12345-0@lo:104: 00010000:00010000:3.0:1787432443.135599:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563e9e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e9eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.135717:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787432443.136317:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787432443.136330:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6508:x1874258609342976:12345-0@lo:104: 00010000:00010000:0.0:1787432443.136342:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e9c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e9c8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.136392:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787432443.136397:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6508:x1874258609342976:12345-0@lo:104: Request processed in 73us (12438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432443.136404:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787432443.136784:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6508:x1874258609342848:12345-0@lo:104: Request processed in 142us (11915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432443.136794:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1787432443.136828:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787432443.136834:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563e9e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e9eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.136842:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e4a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1787432443.136847:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563e9e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e9eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.136857:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563e9e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e9eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432443.136864:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563e9e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e9eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432443.136870:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787432443.137015:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563e9e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e9eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.137022:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787432443.137047:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563e9e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e9eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.137054:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563e9e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e9eb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.137077:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432443.137080:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e9c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e9c8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.137086:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fd000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1787432443.137088:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e9c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e9c8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.137096:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e9c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e9c8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432443.137102:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e9c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e9c8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432443.137107:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787432443.137994:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609343232:0@lo:103: 00000100:00100000:1.0:1787432443.138426:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432443.139452:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609343232 00000100:00100000:1.0:1787432443.139462:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609343232 00010000:00010000:1.0:1787432443.139499:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948303013e00/0xca72b3b33563e9eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e9e4 expref: 22 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432443.139537:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787432443.139547:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:3643:x1874258609343232:12345-0@lo:103: 00010000:00010000:1.0:1787432443.139561:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432443.139566:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948303013e00/0xca72b3b33563e9eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e9e4 expref: 22 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.139578:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948303013e00/0xca72b3b33563e9eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e9e4 expref: 22 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.139614:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432443.139672:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:3643:x1874258609343232:12345-0@lo:103: Request processed in 126us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432443.139680:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787432443.139725:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609343232:0@lo:103: 00010000:00010000:3.0:1787432443.140616:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e9c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e9c8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.140627:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787432443.140653:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e9c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e9c8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.140662:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563e9c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e9c8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432443.140673:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609343360:0@lo:103: 00010000:00010000:3.0:1787432443.140678:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432443.140680:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432443.140681:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432443.140687:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432443.140716:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432443.141117:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609343360 00000100:00100000:3.0:1787432443.141124:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609343360 00010000:00010000:3.0:1787432443.141148:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484013fcc00/0xca72b3b33563e9c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e9c1 expref: 22 pid: 6507 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432443.141196:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787432443.141205:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435bab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:3644:x1874258609343360:12345-0@lo:103: 00010000:00010000:3.0:1787432443.141215:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432443.141220:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484013fcc00/0xca72b3b33563e9c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e9c1 expref: 22 pid: 6507 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.141230:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484013fcc00/0xca72b3b33563e9c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e9c1 expref: 22 pid: 6507 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.141245:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432443.141285:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435bab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:3644:x1874258609343360:12345-0@lo:103: Request processed in 81us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432443.141291:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787432443.141440:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609343360:0@lo:103: 00000100:00100000:3.0:1787432443.141847:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609343104 00000100:00100000:3.0:1787432443.141853:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609343104 00000100:00100000:3.0:1787432443.141890:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787432443.141898:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433652680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6508:x1874258609343104:12345-0@lo:104: 00010000:00010000:3.0:1787432443.141909:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563e99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e9a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.141961:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787432443.141967:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433652680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6508:x1874258609343104:12345-0@lo:104: Request processed in 71us (9776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432443.141974:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1787432443.142020:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432443.142028:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563e99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e9a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.142035:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fd400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1787432443.142039:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563e99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e9a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.142048:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563e99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e9a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432443.142070:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563e99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e9a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432443.142076:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432443.142110:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563e99e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e9a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.142117:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432443.142143:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563e99e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e9a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.142150:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563e99e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e9a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.142182:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432443.142184:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432443.142186:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432443.142246:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432443.142260:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609343488:0@lo:103: 00000100:00100000:2.0:1787432443.142293:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432443.142327:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609343488 00000100:00100000:2.0:1787432443.142331:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609343488 00010000:00010000:2.0:1787432443.142348:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484032e4800/0xca72b3b33563e9a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e99e expref: 22 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432443.142379:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787432443.142386:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433653480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:3642:x1874258609343488:12345-0@lo:103: 00010000:00010000:2.0:1787432443.142394:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432443.142398:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484032e4800/0xca72b3b33563e9a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e99e expref: 22 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.142407:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484032e4800/0xca72b3b33563e9a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e99e expref: 22 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.142420:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432443.142446:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433653480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:3642:x1874258609343488:12345-0@lo:103: Request processed in 62us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432443.142452:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787432443.142478:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609343488:0@lo:103: 00010000:00010000:2.0:1787432443.142494:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484032e5200/0xca72b3b33563e982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e97b expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.142505:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9484032e5200/0xca72b3b33563e982 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e97b expref: 21 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432443.142514:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433652300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609343616:0@lo:104: 00000100:00100000:2.0:1787432443.142536:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432443.142576:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484013fc800/0xca72b3b33563e966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e95f expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.142584:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9484013fc800/0xca72b3b33563e966 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e95f expref: 21 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432443.142603:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359ea300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609343744:0@lo:104: 00000100:00100000:2.0:1787432443.142625:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432443.142663:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948400030c00/0xca72b3b33563e927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e920 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432443.142663:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609343616 00000100:00100000:1.0:1787432443.142667:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609343616 00010000:00010000:2.0:1787432443.142671:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948400030c00/0xca72b3b33563e927 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e920 expref: 21 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432443.142679:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609343872:0@lo:104: 00000100:00100000:1.0:1787432443.142689:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609343744 00000100:00100000:1.0:1787432443.142692:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609343744 00000100:00100000:2.0:1787432443.142702:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432443.142705:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787432443.142711:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433652d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6508:x1874258609343616:12345-0@lo:104: 00010000:00010000:2.0:1787432443.142717:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484032e5400/0xca72b3b33563e8fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e8f6 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.142719:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563e97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e982 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.142753:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787432443.142758:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433652d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6508:x1874258609343616:12345-0@lo:104: Request processed in 48us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432443.142764:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787432443.142783:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787432443.142814:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609343872 00000100:00100000:1.0:1787432443.142818:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609343872 00000100:00100000:1.0:1787432443.142833:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787432443.142839:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6508:x1874258609343744:12345-0@lo:104: 00010000:00010000:1.0:1787432443.142853:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563e95f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e966 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.142895:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787432443.142901:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6508:x1874258609343744:12345-0@lo:104: Request processed in 62us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432443.142908:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1787432443.142914:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787432443.142919:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563e97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e982 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432443.142921:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1787432443.142926:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e4200 already unused, calling callback (ffffffffc122fc20) 00000100:00100000:1.0:1787432443.142927:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e59450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6508:x1874258609343872:12345-0@lo:104: 10000000:00010000:0.0:1787432443.142929:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563e97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e982 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.142934:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484013fdc00/0xca72b3b33563e920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e927 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.142936:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563e97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e982 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432443.142943:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563e97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e982 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432443.142954:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432443.142957:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787432443.142962:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e59450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6508:x1874258609343872:12345-0@lo:104: Request processed in 36us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432443.142967:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1787432443.142974:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563e97b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e982 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.142980:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432443.142994:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563e97b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e982 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.143001:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563e97b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e982 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.143002:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787432443.143011:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432443.143014:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484013fdc00/0xca72b3b33563e920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e927 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.143019:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fdc00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1787432443.143022:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484013fdc00/0xca72b3b33563e920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e927 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.143029:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484013fdc00/0xca72b3b33563e920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e927 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432443.143034:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484013fdc00/0xca72b3b33563e920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e927 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432443.143039:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432443.143052:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484013fdc00/0xca72b3b33563e920 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e927 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.143058:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432443.143076:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484013fdc00/0xca72b3b33563e920 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e927 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.143082:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484013fdc00/0xca72b3b33563e920 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e927 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.143092:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432443.143094:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432443.143095:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432443.143399:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609344256:0@lo:103: 00000100:00100000:0.0:1787432443.143432:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432443.143463:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609344256 00000100:00100000:0.0:1787432443.143467:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609344256 00010000:00010000:0.0:1787432443.143482:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948400030c00/0xca72b3b33563e927 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e920 expref: 22 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432443.143504:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787432443.143511:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94841223e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:3643:x1874258609344256:12345-0@lo:103: 00010000:00010000:0.0:1787432443.143518:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432443.143523:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948400030c00/0xca72b3b33563e927 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e920 expref: 22 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.143602:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9484032e5400/0xca72b3b33563e8fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e8f6 expref: 22 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432443.143613:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609344000:0@lo:104: 00000100:00100000:2.0:1787432443.143625:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609344128:0@lo:103: 00000100:00100000:2.0:1787432443.143660:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432443.143702:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609344128 00000100:00100000:2.0:1787432443.143706:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609344128 00010000:00010000:2.0:1787432443.143720:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484032e5200/0xca72b3b33563e982 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e97b expref: 23 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432443.143756:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787432443.143763:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:3642:x1874258609344128:12345-0@lo:103: 00010000:00010000:2.0:1787432443.145257:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432443.145279:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484032e5200/0xca72b3b33563e982 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e97b expref: 23 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432443.145414:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432443.145466:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483026db840 going to sleep for 11 seconds 00010000:00010000:3.0:1787432443.145491:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303013e00/0xca72b3b33563e9eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e9e4 expref: 23 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432443.145504:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609342848:0@lo:104: 00010000:00010000:3.0:1787432443.145515:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fcc00/0xca72b3b33563e9c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e9c1 expref: 22 pid: 6507 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432443.145524:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609342976:0@lo:104: 00010000:00010000:3.0:1787432443.145534:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e4800/0xca72b3b33563e9a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e99e expref: 21 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432443.145541:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609343104:0@lo:104: 00000100:00100000:3.0:1787432443.145547:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433652300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609343616:0@lo:104: 00000100:00100000:3.0:1787432443.145555:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359ea300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609343744:0@lo:104: 00000100:00100000:3.0:1787432443.145562:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609343872:0@lo:104: 00000100:00100000:1.0:1787432443.149427:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609344000 00000100:00100000:1.0:1787432443.149447:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609344000 00000100:00100000:1.0:1787432443.149512:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787432443.149523:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f858700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6508:x1874258609344000:12345-0@lo:104: 00010000:00010000:1.0:1787432443.149542:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484013fce00/0xca72b3b33563e8f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e8fd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.149970:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948400030c00/0xca72b3b33563e927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e920 expref: 20 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.149992:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948400030c00/0xca72b3b33563e927 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e920 expref: 20 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.150010:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432443.150050:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94841223e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:3643:x1874258609344256:12345-0@lo:103: Request processed in 6539us (6617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432443.150072:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787432443.150157:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609344256:0@lo:103: 00010000:00010000:1.0:1787432443.150666:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787432443.150674:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f858700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6508:x1874258609344000:12345-0@lo:104: Request processed in 1153us (5260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432443.150680:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787432443.150748:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6508:1874258609344000:0@lo:104: 00010000:00010000:1.0:1787432443.150781:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9484032e5600/0xca72b3b33563ea07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.150795:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432443.150801:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484013fce00/0xca72b3b33563e8f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e8fd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.150809:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fce00 already unused, calling callback (ffffffffc122fc20) 00010000:00010000:1.0:1787432443.150811:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563e95f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e966 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432443.150813:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484013fce00/0xca72b3b33563e8f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e8fd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.150818:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948401683a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432443.150820:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563e95f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e966 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.150822:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484013fce00/0xca72b3b33563e8f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e8fd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.150826:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563e95f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e966 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432443.150829:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484013fce00/0xca72b3b33563e8f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e8fd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432443.150832:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563e95f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e966 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432443.150838:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787432443.150840:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432443.150877:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563e95f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e966 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.150883:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432443.150899:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563e95f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e966 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.150906:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563e95f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e966 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.150916:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432443.150918:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432443.150920:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432443.150940:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609344384:0@lo:103: 00010000:00010000:0.0:1787432443.150946:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432443.150979:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432443.151063:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609344384 00000100:00100000:0.0:1787432443.151069:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609344384 00010000:00010000:0.0:1787432443.151089:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484013fc800/0xca72b3b33563e966 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e95f expref: 19 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432443.151112:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787432443.151121:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:3644:x1874258609344384:12345-0@lo:103: 00010000:00010000:0.0:1787432443.151131:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432443.151135:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484013fc800/0xca72b3b33563e966 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e95f expref: 19 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.151143:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484013fc800/0xca72b3b33563e966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e95f expref: 19 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.151156:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fc800/0xca72b3b33563e966 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e95f expref: 19 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.151220:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432443.151252:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:3644:x1874258609344384:12345-0@lo:103: Request processed in 133us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432443.151259:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1787432443.152046:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484032e5200/0xca72b3b33563e982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e97b expref: 17 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.152062:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e5200/0xca72b3b33563e982 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e97b expref: 17 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.152072:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432443.152130:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:3642:x1874258609344128:12345-0@lo:103: Request processed in 8367us (8468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432443.152138:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787432443.152284:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609344128:0@lo:103: 00000100:00100000:0.0:1787432443.153687:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609344384:0@lo:103: 00010000:00010000:3.0:1787432443.153899:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484013fce00/0xca72b3b33563e8f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e8fd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.153910:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787432443.153930:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484013fce00/0xca72b3b33563e8f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e8fd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.153938:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484013fce00/0xca72b3b33563e8f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e8fd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432443.153965:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609344512:0@lo:103: 00000100:00100000:3.0:1787432443.154018:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432443.154074:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609344512 00000100:00100000:3.0:1787432443.154079:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609344512 00010000:00010000:3.0:1787432443.154105:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484032e5400/0xca72b3b33563e8fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e8f6 expref: 16 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432443.154131:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787432443.154140:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:3641:x1874258609344512:12345-0@lo:103: 00010000:00010000:3.0:1787432443.154151:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432443.154157:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484032e5400/0xca72b3b33563e8fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e8f6 expref: 16 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.154187:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484032e5400/0xca72b3b33563e8fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e8f6 expref: 16 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.154200:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e5400/0xca72b3b33563e8fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e8f6 expref: 16 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.154230:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9484032e5600/0xca72b3b33563ea07 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.154238:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e5600/0xca72b3b33563ea07 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.154253:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9484032e5600/0xca72b3b33563ea07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.154260:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9484032e5600/0xca72b3b33563ea07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.154268:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9484032e5600/0xca72b3b33563ea07 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.154275:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9484032e5600/0xca72b3b33563ea07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.154281:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e5600 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432443.154285:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9484032e5600/0xca72b3b33563ea07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.154293:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9484032e5600/0xca72b3b33563ea07 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.154308:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9484032e5600/0xca72b3b33563ea07 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.154318:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432443.154351:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:3641:x1874258609344512:12345-0@lo:103: Request processed in 212us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432443.154367:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787432443.154399:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609344512:0@lo:103: 00010000:00010000:3.0:1787432443.154417:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432443.154419:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432443.154420:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432443.156269:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9484032e5600/0xca72b3b33563ea07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.156301:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9484032e5600/0xca72b3b33563ea07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.156309:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e5600/0xca72b3b33563ea07 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787432443.156325:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787432443.160148:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840507a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:9508:x1874258609342720:12345-0@lo:253: Request processed in 69254us (69379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432443.160198:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787432443.160320:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609342720:0@lo:253: 10000000:01000000:3.0:1787432443.160346:0:9508:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787432443.160350:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787432443.160351:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787432443.160353:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432443.160354:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787432443.160355:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432443.160357:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432443.160358:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787432443.160360:0:9508:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787432443.160362:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432443.160363:0:9508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787432443.160384:0:9508:0:(tgt_mount.c:101:server_register_mount()) register mount ffff948435bcb800 from lustre-OST0001 10000000:01000000:3.0:1787432443.160414:0:9508:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787432443.160418:0:9508:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787432443.160426:0:9508:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9484336199b8 local copy 10000000:01000000:3.0:1787432443.160430:0:9508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787432443.160466:0:9508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303013e00/0xca72b3b33563ea0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.160477:0:9508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.124@tcp lock: ffff948303013e00/0xca72b3b33563ea0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.160486:0:9508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948303013e00/0xca72b3b33563ea0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432443.160504:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f859f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609344640:0@lo:101: 00000100:00100000:3.0:1787432443.160554:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432443.160592:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830316b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432443.160592:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609344640 00000100:00100000:1.0:1787432443.160598:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609344640 00000100:00100000:1.0:1787432443.160651:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787432443.160660:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840507a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+14:9508:x1874258609344640:12345-0@lo:101: 00010000:00010000:1.0:1787432443.160674:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432443.160686:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948401682200/0xca72b3b33563ea15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ea0e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.160709:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948401682200/0xca72b3b33563ea15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ea0e expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.160720:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948401682200/0xca72b3b33563ea15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ea0e expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.160728:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948401682200, rc 0) 00000100:00100000:1.0:1787432443.160767:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840507a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:9508:x1874258609344640:12345-0@lo:101: Request processed in 108us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432443.160773:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787432443.160804:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f859f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609344640:0@lo:101: 00010000:00010000:3.0:1787432443.160817:0:9508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948303013e00/0xca72b3b33563ea0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xca72b3b33563ea15 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.160825:0:9508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948303013e00/0xca72b3b33563ea0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xca72b3b33563ea15 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432443.160920:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f859f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609344768:0@lo:501: 00000100:00100000:3.0:1787432443.160946:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432443.160969:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830316b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432443.161046:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609344768 00000100:00100000:0.0:1787432443.161051:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609344768 00000100:00100000:0.0:1787432443.161083:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787432443.161090:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:9508:x1874258609344768:12345-0@lo:501: 00000100:00100000:0.0:1787432443.161157:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:9508:x1874258609344768:12345-0@lo:501: Request processed in 68us (209us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787432443.161185:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787432443.161247:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f859f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609344768:0@lo:501: 10000000:01000000:1.0:1787432443.161260:0:9508:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787432443.161278:0:9508:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787432443.161283:0:9508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303013e00/0xca72b3b33563ea0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xca72b3b33563ea15 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.161290:0:9508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303013e00/0xca72b3b33563ea0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xca72b3b33563ea15 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.161306:0:9508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff948303013e00/0xca72b3b33563ea0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xca72b3b33563ea15 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.161334:0:9508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787432443.161356:0:9508:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff948435bcb800 10000000:01000000:1.0:1787432443.161361:0:9508:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787432443.161365:0:9508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787432443.161368:0:9508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787432443.161371:0:9508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787432443.161374:0:9508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787432443.161389:0:9508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ea1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.161396:0:9508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ea1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.161397:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432443.161404:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948303013e00/0xca72b3b33563ea0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xca72b3b33563ea15 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.161404:0:9508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ea1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.161412:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013e00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432443.161415:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948303013e00/0xca72b3b33563ea0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xca72b3b33563ea15 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432443.161416:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609344896:0@lo:101: 00010000:00010000:2.0:1787432443.161423:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948303013e00/0xca72b3b33563ea0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xca72b3b33563ea15 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432443.161431:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948303013e00/0xca72b3b33563ea0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xca72b3b33563ea15 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432443.161437:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787432443.161440:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432443.161455:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948303013e00/0xca72b3b33563ea0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xca72b3b33563ea15 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.161462:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787432443.161466:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff948302715780 going to sleep for 11 seconds 00000100:00100000:3.0:1787432443.161507:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609344896 00000100:00100000:3.0:1787432443.161511:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609344896 00000100:00100000:3.0:1787432443.161544:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787432443.161551:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:9508:x1874258609344896:12345-0@lo:101: 00010000:00010000:3.0:1787432443.161559:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432443.161567:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303012e00/0xca72b3b33563ea23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ea1c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.161581:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303012e00/0xca72b3b33563ea23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ea1c expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.161589:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303012e00/0xca72b3b33563ea23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ea1c expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.161596:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303012e00, rc 0) 00000100:00100000:3.0:1787432443.161631:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:9508:x1874258609344896:12345-0@lo:101: Request processed in 80us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432443.161653:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787432443.161670:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609344896:0@lo:101: 00010000:00010000:1.0:1787432443.161680:0:9508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ea1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ea23 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.161688:0:9508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ea1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ea23 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432443.161708:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609345024:0@lo:103: 00000100:00100000:1.0:1787432443.161750:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609345152:0@lo:501: 00010000:00010000:2.0:1787432443.161951:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948303013e00/0xca72b3b33563ea0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xca72b3b33563ea15 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.161959:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948303013e00/0xca72b3b33563ea0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xca72b3b33563ea15 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.161971:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432443.161973:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432443.161975:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432443.164415:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432443.164512:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff948302715780 going to sleep for 11 seconds 00000100:00100000:0.0:1787432443.165932:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432443.166998:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609345152 00000100:00100000:3.0:1787432443.167009:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609345152 00000100:00100000:3.0:1787432443.167346:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787432443.167358:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:9508:x1874258609345152:12345-0@lo:501: 00000100:00100000:3.0:1787432443.167531:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:9508:x1874258609345152:12345-0@lo:501: Request processed in 175us (3122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432443.167538:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787432443.167642:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609345024 00000100:00100000:2.0:1787432443.167648:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609345024 00000100:00100000:2.0:1787432443.167683:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787432443.167690:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:3642:x1874258609345024:12345-0@lo:103: 00010000:00010000:2.0:1787432443.167700:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432443.167718:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948401682200/0xca72b3b33563ea15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563ea0e expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432443.167944:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609345152:0@lo:501: 00000100:00100000:0.0:1787432443.167993:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609345280:0@lo:503: 00000100:00100000:0.0:1787432443.168051:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432443.168093:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432443.168132:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:3642:x1874258609345024:12345-0@lo:103: Request processed in 442us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432443.168139:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787432443.168189:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609345024:0@lo:103: 00000100:00100000:1.0:1787432443.171151:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609345280 00000100:00100000:1.0:1787432443.171193:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609345280 00000100:00100000:1.0:1787432443.171248:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787432443.171262:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:9508:x1874258609345280:12345-0@lo:503: 00000100:00100000:1.0:1787432443.171432:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:9508:x1874258609345280:12345-0@lo:503: Request processed in 174us (3381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432443.171440:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787432443.175270:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303015000 going to sleep for 11 seconds 00000100:00100000:0.0:1787432443.175312:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609345280:0@lo:503: 00000040:00080000:0.0:1787432443.175680:0:9508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787432443.175876:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609345408:0@lo:502: 00000100:00100000:0.0:1787432443.175942:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432443.176026:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484067dacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432443.177985:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609345408 00000100:00100000:1.0:1787432443.178000:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609345408 00000100:00100000:1.0:1787432443.178068:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787432443.178080:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:9508:x1874258609345408:12345-0@lo:502: 00000100:00100000:1.0:1787432443.178259:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:9508:x1874258609345408:12345-0@lo:502: Request processed in 182us (2317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432443.178267:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787432443.178533:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609345408:0@lo:502: 00000040:00080000:0.0:1787432443.179051:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787432443.179083:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787432443.179099:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787432443.179113:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787432443.179126:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787432443.179140:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787432443.179281:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609345536:0@lo:502: 00000100:00100000:0.0:1787432443.179409:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432443.179451:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484067dacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432443.179601:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609345536 00000100:00100000:3.0:1787432443.179607:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609345536 00000100:00100000:3.0:1787432443.179663:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787432443.179671:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:9508:x1874258609345536:12345-0@lo:502: 00000100:00100000:3.0:1787432443.179771:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:9508:x1874258609345536:12345-0@lo:502: Request processed in 100us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432443.179779:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787432443.179816:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609345536:0@lo:502: 00000040:00080000:0.0:1787432443.179869:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787432443.179878:0:9508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1787432443.180517:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787432443.180525:0:9520:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787432443.180531:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432443.180533:0:9520:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787432443.180538:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787432443.180553:0:9520:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9483030f4d28) 00000020:00000080:3.0:1787432443.180574:0:9520:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787432443.180579:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787432443.180661:0:9520:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948435bcb800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787432443.180669:0:9520:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787432443.180675:0:9520:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xca72b3b33563ea31 00010000:00010000:0.0:1787432443.187690:0:9520:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1787432443.188395:0:9520:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787432443.198156:0:9520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787432443.198593:0:9520:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787432443.206275:0:9520:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1787432443.206961:0:9520:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1787432443.223018:0:9520:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1787432443.234960:0:9520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787432443.234972:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432443.234989:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432443.234991:0:9520:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787432443.234995:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432443.234999:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432443.235000:0:9520:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787432443.235004:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787432443.235006:0:9520:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787432443.235111:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432443.235114:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432443.235115:0:9520:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787432443.235119:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787432443.236656:0:9508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787432443.236698:0:9508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787432443.236795:0:9508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ea1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ea23 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.236810:0:9508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ea1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ea23 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432443.236834:0:9508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948435bcb800 from 1 10000000:01000000:0.0:1787432443.236837:0:9508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787432443.236874:0:9508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948400030c00/0xca72b3b33563ea38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.236883:0:9508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948400030c00/0xca72b3b33563ea38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.236894:0:9508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948400030c00/0xca72b3b33563ea38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432443.236918:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609345664:0@lo:101: 00000100:00100000:0.0:1787432443.236987:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432443.237030:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841de54d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432443.237090:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609345664 00000100:00100000:2.0:1787432443.237097:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609345664 00000100:00100000:2.0:1787432443.237150:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787432443.237160:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:9508:x1874258609345664:12345-0@lo:101: 00010000:00010000:2.0:1787432443.237447:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432443.237461:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484032e5200/0xca72b3b33563ea3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ea38 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.237495:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e5200/0xca72b3b33563ea3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ea38 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.237506:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484032e5200/0xca72b3b33563ea3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ea38 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.237514:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e5200, rc 0) 00000100:00100000:2.0:1787432443.237612:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:9508:x1874258609345664:12345-0@lo:101: Request processed in 452us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432443.237619:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787432443.240289:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609345664:0@lo:101: 00010000:00010000:0.0:1787432443.240321:0:9508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948400030c00/0xca72b3b33563ea38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ea3f expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.240334:0:9508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948400030c00/0xca72b3b33563ea38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ea3f expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432443.245105:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609345792:0@lo:501: 00000100:00100000:2.0:1787432443.245199:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432443.245247:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483026db000 going to sleep for 11 seconds 00000100:00100000:1.0:1787432443.245323:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609345792 00000100:00100000:1.0:1787432443.245331:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609345792 00000100:00100000:1.0:1787432443.245384:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787432443.245394:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:9508:x1874258609345792:12345-0@lo:501: 00000100:00100000:1.0:1787432443.245513:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:9508:x1874258609345792:12345-0@lo:501: Request processed in 119us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432443.245521:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787432443.245665:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609345792:0@lo:501: 00000100:00100000:0.0:1787432443.245702:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609345920:0@lo:503: 00000100:00100000:0.0:1787432443.245853:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432443.245876:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841de54d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432443.245927:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609345920 00000100:00100000:1.0:1787432443.245931:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609345920 00000100:00100000:1.0:1787432443.245966:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787432443.245973:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:9508:x1874258609345920:12345-0@lo:503: 00000100:00100000:1.0:1787432443.246053:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:9508:x1874258609345920:12345-0@lo:503: Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432443.246060:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787432443.246139:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609345920:0@lo:503: 00000040:00080000:0.0:1787432443.246405:0:9508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787432443.246469:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609346048:0@lo:502: 00000100:00100000:0.0:1787432443.246508:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432443.246534:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841de54d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432443.246602:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609346048 00000100:00100000:2.0:1787432443.246607:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609346048 00000100:00100000:2.0:1787432443.246943:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787432443.246954:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:9508:x1874258609346048:12345-0@lo:502: 00000100:00100000:2.0:1787432443.247050:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:9508:x1874258609346048:12345-0@lo:502: Request processed in 98us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432443.247057:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787432443.247102:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609346048:0@lo:502: 00000040:00080000:2.0:1787432443.247327:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787432443.247355:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787432443.247381:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609346176:0@lo:502: 00000100:00100000:2.0:1787432443.247420:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432443.247438:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112dff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432443.247460:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609346176 00000100:00100000:2.0:1787432443.247464:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609346176 00000100:00100000:2.0:1787432443.247485:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787432443.247492:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:9508:x1874258609346176:12345-0@lo:502: 00000100:00100000:2.0:1787432443.247555:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:9508:x1874258609346176:12345-0@lo:502: Request processed in 64us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432443.247562:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787432443.247600:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609346176:0@lo:502: 00000040:00080000:2.0:1787432443.247649:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787432443.247656:0:9508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787432443.254794:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432443.254810:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432443.254813:0:9524:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787432443.254821:0:9524:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948435bcb800 00000020:00000080:1.0:1787432443.254823:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787432443.254836:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432443.254839:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432443.254840:0:9524:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787432443.254843:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787432443.254996:0:9508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787432443.255025:0:9508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432443.255046:0:9508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948400030c00/0xca72b3b33563ea38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ea3f expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.255059:0:9508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948400030c00/0xca72b3b33563ea38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ea3f expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432443.255113:0:9508:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787432443.255117:0:9508:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff948435bcb800 10000000:01000000:2.0:1787432443.255120:0:9508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff948435bcb800 10000000:01000000:2.0:1787432443.255125:0:9508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787432443.255131:0:9508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948435bcb800 from 1 10000000:01000000:2.0:1787432443.255134:0:9508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787432443.255198:0:9508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5400/0xca72b3b33563ea46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.255208:0:9508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484032e5400/0xca72b3b33563ea46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.255231:0:9508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484032e5400/0xca72b3b33563ea46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432443.255257:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609346304:0@lo:101: 00000100:00100000:2.0:1787432443.255323:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432443.255371:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112dff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432443.255414:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609346304 00000100:00100000:3.0:1787432443.255424:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609346304 00000100:00100000:3.0:1787432443.255477:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787432443.255488:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:9508:x1874258609346304:12345-0@lo:101: 00010000:00010000:3.0:1787432443.255501:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432443.255514:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303013400/0xca72b3b33563ea4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ea46 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.255536:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303013400/0xca72b3b33563ea4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ea46 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.255547:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303013400/0xca72b3b33563ea4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ea46 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.255555:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303013400, rc 0) 00000100:00100000:3.0:1787432443.255608:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:9508:x1874258609346304:12345-0@lo:101: Request processed in 121us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432443.255616:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787432443.255748:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609346304:0@lo:101: 00010000:00010000:2.0:1787432443.255761:0:9508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484032e5400/0xca72b3b33563ea46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ea4d expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.255770:0:9508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484032e5400/0xca72b3b33563ea46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ea4d expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432443.255846:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609346432:0@lo:501: 00000100:00100000:2.0:1787432443.255872:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432443.255924:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112dff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432443.256380:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609346432 00000100:00100000:0.0:1787432443.256386:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609346432 00000100:00100000:1.0:1787432443.257016:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787432443.257027:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:9508:x1874258609346432:12345-0@lo:501: 00000100:00100000:1.0:1787432443.257197:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:9508:x1874258609346432:12345-0@lo:501: Request processed in 171us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432443.257204:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787432443.257217:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609346432:0@lo:501: 00000100:00100000:3.0:1787432443.257260:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f859500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609346560:0@lo:503: 00000100:00100000:3.0:1787432443.257318:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432443.257362:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830316be40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432443.259942:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609346560 00000100:00100000:2.0:1787432443.259959:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609346560 00000100:00100000:2.0:1787432443.260040:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787432443.260051:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:9508:x1874258609346560:12345-0@lo:503: 00000100:00100000:2.0:1787432443.260267:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:9508:x1874258609346560:12345-0@lo:503: Request processed in 217us (2948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432443.260276:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787432443.260305:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f859500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609346560:0@lo:503: 00000040:00080000:3.0:1787432443.260580:0:9508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787432443.260670:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f859500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609346688:0@lo:502: 00000100:00100000:3.0:1787432443.260718:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432443.260758:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830316be40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432443.265078:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609346688 00000100:00100000:2.0:1787432443.265094:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609346688 00000100:00100000:2.0:1787432443.265194:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787432443.265207:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:9508:x1874258609346688:12345-0@lo:502: 00000100:00100000:2.0:1787432443.265418:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:9508:x1874258609346688:12345-0@lo:502: Request processed in 213us (4698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432443.265426:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787432443.265694:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f859500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609346688:0@lo:502: 00000040:00080000:3.0:1787432443.265999:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787432443.266040:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787432443.266053:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787432443.266067:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787432443.266078:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787432443.266104:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787432443.266121:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787432443.266146:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787432443.266190:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787432443.266211:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787432443.266226:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787432443.266241:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787432443.266254:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787432443.266267:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787432443.266279:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787432443.266292:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787432443.266322:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787432443.266465:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787432443.266481:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787432443.266494:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787432443.266505:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787432443.266515:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787432443.266538:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787432443.266552:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787432443.266565:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787432443.266576:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787432443.266588:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787432443.266600:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1787432443.266613:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787432443.266626:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1787432443.266653:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1787432443.266667:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1787432443.266696:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1787432443.266711:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1787432443.266725:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1787432443.266739:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1787432443.266752:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1787432443.266765:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1787432443.266777:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1787432443.266789:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1787432443.266803:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1787432443.266816:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1787432443.266828:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1787432443.266841:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1787432443.266853:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1787432443.266865:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1787432443.266902:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f859500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609346816:0@lo:502: 00000100:00100000:3.0:1787432443.266968:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432443.267008:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609346816 00000100:00100000:3.0:1787432443.267013:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830316be40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432443.267013:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609346816 00000100:00100000:2.0:1787432443.267059:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787432443.267069:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:9508:x1874258609346816:12345-0@lo:502: 00000100:00100000:2.0:1787432443.267211:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:9508:x1874258609346816:12345-0@lo:502: Request processed in 142us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432443.267219:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787432443.267308:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f859500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609346816:0@lo:502: 00000040:00080000:0.0:1787432443.267355:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1787432443.267363:0:9508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1787432443.272639:0:9525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787432443.272660:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9483030f19b8) 00000020:00000080:3.0:1787432443.272686:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1787432443.272784:0:9525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948435bcb800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787432443.272788:0:9525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948435bcb800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787432443.272879:0:9525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948435bcb800 3 00010000:00080000:3.0:1787432443.272915:0:9525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94843c7ed800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.124@tcp at head 00010000:00010000:3.0:1787432443.283657:0:9525:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1787432443.284046:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787432443.284103:0:9525:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787432443.284118:0:9525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xca72b3b33563ea5b 00000100:00080000:3.0:1787432443.284586:0:9525:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787432443.284597:0:9525:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94843c7ed800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432443.284648:0:9525:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94843f85a300 x1874258609346944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432443.284677:0:9525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787432443.284856:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609347200:0@lo:400: 00000100:00100000:2.0:1787432443.284925:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432443.284960:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609347712:0@lo:400: 00000100:00100000:2.0:1787432443.284985:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432443.285007:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787432443.285012:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609347072:0@lo:400: 00000100:00100000:2.0:1787432443.285033:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432443.285050:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609347584:0@lo:400: 00000100:00100000:2.0:1787432443.285071:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432443.285096:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609347328:0@lo:400: 00000100:00100000:2.0:1787432443.285120:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432443.285145:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609347840:0@lo:400: 00000100:00100000:2.0:1787432443.285199:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432443.285220:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787432443.285225:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609347712 00000100:00100000:2.0:1787432443.285226:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609347456:0@lo:400: 00000100:00100000:3.0:1787432443.285231:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609347712 00000100:00100000:2.0:1787432443.285263:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432443.285270:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609347072 00000100:00100000:3.0:1787432443.285273:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609347072 00000100:00100000:2.0:1787432443.285281:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609347968:0@lo:400: 00000100:00100000:3.0:1787432443.285285:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609347584 00000100:00100000:3.0:1787432443.285287:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609347584 00000100:00100000:3.0:1787432443.285297:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609347328 00000100:00100000:3.0:1787432443.285299:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609347328 00000100:00100000:2.0:1787432443.285299:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432443.285315:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787432443.285327:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609347200 00000100:00100000:2.0:1787432443.285331:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609347200 00000100:00100000:3.0:1787432443.285336:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609347712:12345-0@lo:400: 00000100:00100000:2.0:1787432443.285356:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609347456 00000100:00100000:2.0:1787432443.285358:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609347456 00000100:00100000:2.0:1787432443.285371:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787432443.285377:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609347200:12345-0@lo:400: 00000100:00100000:3.0:1787432443.285390:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609347712:12345-0@lo:400: Request processed in 67us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432443.285397:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787432443.285405:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609347200:12345-0@lo:400: Request processed in 30us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432443.285411:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787432443.285412:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787432443.285417:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609347072:12345-0@lo:400: 00000100:00100000:2.0:1787432443.285421:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787432443.285426:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609347456:12345-0@lo:400: 00000100:00100000:3.0:1787432443.285441:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609347072:12345-0@lo:400: Request processed in 24us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432443.285447:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787432443.285452:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609347456:12345-0@lo:400: Request processed in 26us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432443.285457:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787432443.285464:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787432443.285470:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609347584:12345-0@lo:400: 00000100:00100000:2.0:1787432443.285472:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787432443.285477:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609347328:12345-0@lo:400: 00000100:00100000:3.0:1787432443.285498:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609347584:12345-0@lo:400: Request processed in 28us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432443.285499:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609347328:12345-0@lo:400: Request processed in 22us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432443.285504:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787432443.285557:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874258609346944:0@lo:38: 00000100:00100000:1.0:1787432443.285590:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432443.286236:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609346944 00000100:00100000:3.0:1787432443.286242:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609346944 00000100:00100000:0.0:1787432443.290278:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609347840 00000100:00100000:0.0:1787432443.290292:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609347840 00000100:00100000:0.0:1787432443.290364:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609347968 00000100:00100000:0.0:1787432443.290368:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609347968 00000100:00100000:1.0:1787432443.290375:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787432443.290387:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609347840:12345-0@lo:400: 00000100:00100000:0.0:1787432443.290388:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432443.290394:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609347968:12345-0@lo:400: 00000100:00100000:1.0:1787432443.290695:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609347840:12345-0@lo:400: Request processed in 310us (5494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432443.290704:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432443.291440:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609347968:12345-0@lo:400: Request processed in 1042us (6135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432443.291450:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432443.292654:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787432443.292749:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609347456:0@lo:400: 00010000:00080000:2.0:1787432443.292767:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9484359e8700 x1874258609347968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432443.292780:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609347968:0@lo:400: 00010000:00080000:2.0:1787432443.292807:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9484359e8380 x1874258609347328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432443.292817:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609347328:0@lo:400: 00010000:00080000:2.0:1787432443.292828:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9484359e8a80 x1874258609347840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432443.292837:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609347840:0@lo:400: 00010000:00080000:2.0:1787432443.292890:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9484359eb800 x1874258609347072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432443.292900:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609347072:0@lo:400: 00010000:00080000:2.0:1787432443.292912:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9484359e8e00 x1874258609347584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432443.292919:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609347584:0@lo:400: 00000100:00100000:2.0:1787432443.292930:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609347200:0@lo:400: 00010000:00080000:2.0:1787432443.292940:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9484359eb100 x1874258609347712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432443.292948:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609347712:0@lo:400: 00000020:01000004:2.0:1787432443.294042:0:9525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787432443.294060:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9484349d19b8) 00000100:00080000:0.0:1787432443.294077:0:9526:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff948302766d80 x1874258609348096/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000020:00000080:2.0:1787432443.294084:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:0.0:1787432443.294100:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841de54480 going to sleep for 0 seconds 00000020:01000004:2.0:1787432443.294203:0:9525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948435bcb800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787432443.294207:0:9525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948435bcb800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787432443.294210:0:9525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948435bcb800 3 00010000:00080000:2.0:1787432443.294239:0:9525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94843f84e000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.124@tcp at head 00000100:00100000:3.0:1787432443.294580:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787432443.294590:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874258609346944:12345-0@lo:38: 00010000:00080000:3.0:1787432443.294612:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:3.0:1787432443.294656:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xca72b3b33563ea69 00000004:00100000:3.0:1787432443.294670:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787432443.294709:0:6514:0:(import.c:65:import_set_state_nolock()) ffff9483036ef800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432443.294811:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874258609346944:12345-0@lo:38: Request processed in 221us (9219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432443.294819:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787432443.294857:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94843f85a300 x1874258609346944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432443.294876:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787432443.294883:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787432443.294890:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787432443.294894:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787432443.294896:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7ed800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787432443.294902:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000d76fe69b): req@ffff948302766d80 x1874258609348096/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432443.294917:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874258609346944:0@lo:38: 00000100:00100000:3.0:1787432443.294986:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432443.295006:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841de54480 going to sleep for 11 seconds 00000100:00100000:3.0:1787432443.295033:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609348096 00000100:00100000:3.0:1787432443.295039:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609348096 00000100:00100000:3.0:1787432443.295074:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787432443.295081:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9526:x1874258609348096:12345-0@lo:901: 00010000:00010000:2.0:1787432443.296682:0:9525:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:3.0:1787432443.297453:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9526:x1874258609348096:12345-0@lo:901: Request processed in 2368us (2462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432443.297466:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787432443.297507:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787432443.297542:0:9526:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948302766d80 x1874258609348096/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787432459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432443.297555:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302766d80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9526:1874258609348096:0@lo:901: 00000020:00000080:2.0:1787432443.299306:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787432443.299354:0:9525:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787432443.299368:0:9525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xca72b3b33563ea70 00000100:00080000:2.0:1787432443.299380:0:9525:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787432443.299386:0:9525:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff94843f84e000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432443.299422:0:9525:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9484359eb100 x1874258609348224/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787432443.299465:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1874258609348224:0@lo:38: 00000100:00100000:2.0:1787432443.299525:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432443.299557:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609348224 00000100:00100000:0.0:1787432443.299563:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609348224 00000100:00080000:2.0:1787432443.299577:0:9525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787432443.299600:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787432443.299607:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1874258609348224:12345-0@lo:38: 00010000:00080000:0.0:1787432443.299643:0:9020:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:0.0:1787432443.299703:0:9020:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xca72b3b33563ea77 00000004:00100000:0.0:1787432443.299719:0:9020:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787432443.299760:0:9020:0:(import.c:65:import_set_state_nolock()) ffff9483032f9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432443.299832:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874258609348224:12345-0@lo:38: Request processed in 224us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432443.299840:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:3.0:1787432443.301645:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1787432443.301699:0:9508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1787432443.301727:0:9508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787432443.301749:0:9508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5400/0xca72b3b33563ea46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ea4d expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.301760:0:9508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484032e5400/0xca72b3b33563ea46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ea4d expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787432443.301819:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787432443.301822:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787432443.301823:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432443.301824:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432443.301826:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432443.301827:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432443.301828:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787432443.301830:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787432443.301835:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787432443.301837:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432443.301838:0:9508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787432443.301842:0:9508:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787432443.301845:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787432443.301846:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787432443.301847:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432443.301848:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432443.301849:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432443.301850:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432443.301851:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787432443.301852:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787432443.301853:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787432443.301854:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432443.301855:0:9508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787432443.302012:0:9508:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787432443.302029:0:9508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609348352:0@lo:253: 00000100:00100000:3.0:1787432443.302100:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432443.302126:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609348352 00000100:00100000:1.0:1787432443.302133:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609348352 00000100:00100000:1.0:1787432443.302194:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787432443.302204:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:9508:x1874258609348352:12345-0@lo:253: 00000100:00100000:3.0:1787432443.302223:0:9508:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830316ba80 going to sleep for 11 seconds 20000000:01000000:1.0:1787432443.302229:0:6508:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787432443.302242:0:6508:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1787432443.302831:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9484359eb100 x1874258609348224/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432443.302852:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787432443.302861:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787432443.302869:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787432443.302873:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787432443.302876:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843f84e000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787432443.302883:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1874258609348224:0@lo:38: 20000000:01000000:2.0:1787432443.310285:0:6508:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787432443.310334:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787432443.310606:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:9508:x1874258609348352:12345-0@lo:253: Request processed in 8399us (8500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432443.310619:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 20000000:01000000:0.0:1787432443.311361:0:6529:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787432443.311367:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787432443.311389:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948400030000/0xca72b3b33563ea7e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.311406:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948400031c00/0xca72b3b33563e974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e96d expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.311414:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484032e4c00/0xca72b3b33563e9ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e9b3 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.311420:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948400030000/0xca72b3b33563ea7e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.311461:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484032e4c00/0xca72b3b33563e9ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e9b3 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.311477:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9484032e4c00/0xca72b3b33563e9ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e9b3 expref: 16 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432443.311490:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1874258609348480:0@lo:104: 00000100:00100000:0.0:1787432443.311535:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432443.311590:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948400031c00/0xca72b3b33563e974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e96d expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432443.311599:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948400031c00/0xca72b3b33563e974 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e96d expref: 16 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432443.311627:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1874258609348608:0@lo:104: 00000100:00100000:0.0:1787432443.311664:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432443.311679:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841de54480 going to sleep for 11 seconds 00000100:00100000:1.0:1787432443.311752:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609348480 00000100:00100000:1.0:1787432443.311759:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609348480 00000100:00100000:1.0:1787432443.311808:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609348608 00000100:00100000:1.0:1787432443.311812:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609348608 00000100:00100000:1.0:1787432443.311827:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787432443.311836:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6529:x1874258609348480:12345-0@lo:104: 00010000:00010000:1.0:1787432443.311847:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e9b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e9ba expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.311899:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787432443.311905:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:6529:x1874258609348480:12345-0@lo:104: Request processed in 70us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432443.311912:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787432443.311928:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787432443.311934:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6529:x1874258609348608:12345-0@lo:104: 00010000:00010000:1.0:1787432443.311943:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948401683600/0xca72b3b33563e96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e974 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.311972:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787432443.311977:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:6529:x1874258609348608:12345-0@lo:104: Request processed in 43us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432443.311982:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787432443.311988:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787432443.311995:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e9b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e9ba expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.311998:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432443.312003:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fd600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1787432443.312006:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e9b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e9ba expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.312007:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948401683600/0xca72b3b33563e96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e974 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.312012:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948401683600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432443.312015:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948401683600/0xca72b3b33563e96d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e974 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.312022:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948401683600/0xca72b3b33563e96d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e974 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432443.312029:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948401683600/0xca72b3b33563e96d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e974 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432443.312034:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432443.312060:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948401683600/0xca72b3b33563e96d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e974 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.312067:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432443.312084:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948401683600/0xca72b3b33563e96d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e974 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.312092:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948401683600/0xca72b3b33563e96d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e974 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.312103:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432443.312104:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432443.312106:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432443.312129:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609348736:0@lo:103: 00000100:00100000:1.0:1787432443.312158:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432443.312214:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609348736 00000100:00100000:1.0:1787432443.312218:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609348736 00010000:00010000:1.0:1787432443.312241:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948400031c00/0xca72b3b33563e974 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e96d expref: 17 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432443.312263:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787432443.312270:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:3643:x1874258609348736:12345-0@lo:103: 00010000:00010000:1.0:1787432443.312280:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432443.312285:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948400031c00/0xca72b3b33563e974 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e96d expref: 17 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.312293:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948400031c00/0xca72b3b33563e974 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e96d expref: 17 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.312307:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432443.312334:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:3643:x1874258609348736:12345-0@lo:103: Request processed in 65us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432443.312340:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787432443.312373:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609348736:0@lo:103: 00000100:00100000:1.0:1787432443.312399:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1874258609348480:0@lo:104: 00010000:00010000:1.0:1787432443.312408:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948400031c00/0xca72b3b33563e974 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e96d expref: 16 pid: 6508 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432443.312417:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6529:1874258609348608:0@lo:104: 00010000:00010000:1.0:1787432443.312430:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948400030000/0xca72b3b33563ea7e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.312553:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e9b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e9ba expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432443.312560:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e9b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e9ba expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432443.312565:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787432443.312599:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e9b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e9ba expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.312611:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787432443.312642:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e9b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e9ba expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.312649:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484013fd600/0xca72b3b33563e9b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e9ba expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432443.312663:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432443.312664:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432443.312666:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432443.312691:0:9508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0f84c3f-71b4-4eda-b290-0af337217d3a:9508:1874258609348352:0@lo:253: 10000000:01000000:3.0:1787432443.312702:0:9508:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787432443.312705:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787432443.312707:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000100:00100000:0.0:1787432443.312708:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609348864:0@lo:103: 00000020:01000004:3.0:1787432443.312709:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432443.312710:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432443.312711:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432443.312712:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432443.312714:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787432443.312715:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787432443.312716:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787432443.312718:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432443.312719:0:9508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787432443.312729:0:9508:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787432443.312749:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432443.312942:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609348864 00000100:00100000:2.0:1787432443.312947:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609348864 00010000:00010000:2.0:1787432443.312967:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484032e4c00/0xca72b3b33563e9ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e9b3 expref: 16 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432443.313040:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787432443.313049:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:3644:x1874258609348864:12345-0@lo:103: 00010000:00010000:2.0:1787432443.313057:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432443.313062:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484032e4c00/0xca72b3b33563e9ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e9b3 expref: 16 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.313073:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484032e4c00/0xca72b3b33563e9ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e9b3 expref: 16 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.313084:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e4c00/0xca72b3b33563e9ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e9b3 expref: 16 pid: 6506 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.313097:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948400030000/0xca72b3b33563ea7e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.313104:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948400030000/0xca72b3b33563ea7e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787432443.313117:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005818009s 00010000:00010000:2.0:1787432443.313122:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948400030000/0xca72b3b33563ea7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.313129:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948400030000/0xca72b3b33563ea7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.313136:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948400030000/0xca72b3b33563ea7e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.313143:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948400030000/0xca72b3b33563ea7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.313154:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432443.313159:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948400030000/0xca72b3b33563ea7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.313200:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948400030000/0xca72b3b33563ea7e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.313212:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948400030000/0xca72b3b33563ea7e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432443.313223:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432443.313258:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:3644:x1874258609348864:12345-0@lo:103: Request processed in 211us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432443.313265:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1787432443.313333:0:6529:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948400030000/0xca72b3b33563ea7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.313341:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948400030000/0xca72b3b33563ea7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432443.313354:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948400030000/0xca72b3b33563ea7e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432443.313488:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609348864:0@lo:103: 00080000:10000000:2.0:1787432443.322134:0:9508:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1787432443.322336:0:9508:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787432443.322554:0:9508:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787432443.322721:0:9508:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787432443.324678:0:9508:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1787432443.324897:0:9508:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1787432443.327473:0:9508:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787432443.338510:0:9508:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787432443.338521:0:9508:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787432443.338562:0:9508:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787432443.338602:0:9508:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.124@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787432443.338622:0:9508:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787432443.338659:0:9508:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787432443.339733:0:9508:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432443.342602:0:9508:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1787432444.111091:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787432444.494973:0:9581:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787432444.495420:0:9581:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787432444.875836:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432444.875862:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609348992:0@lo:41: 00000100:00100000:3.0:1787432444.875932:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432444.875998:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609348992 00000100:00100000:3.0:1787432444.876005:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609348992 00000100:00100000:3.0:1787432444.876052:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787432444.876062:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f85a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609348992:12345-0@lo:41: 00000004:00000024:3.0:1787432444.876106:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787432444.876154:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f85a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609348992:12345-0@lo:41: Request processed in 94us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432444.876184:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787432444.876230:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609348992:0@lo:41: 00010000:00010000:1.0:1787432445.138411:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432446.156624:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432447.179778:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432447.947562:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609349120:0@lo:41: 00000100:00100000:3.0:1787432447.947643:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432447.947875:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609349120 00000100:00100000:1.0:1787432447.947885:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609349120 00000100:00100000:1.0:1787432447.947942:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787432447.947955:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609349120:12345-0@lo:41: 00000004:00000024:1.0:1787432447.947999:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1787432447.948061:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609349120:12345-0@lo:41: Request processed in 108us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432447.948069:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787432447.948118:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609349120:0@lo:41: 00000100:00100000:1.0:1787432447.948763:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609349248:0@lo:13: 00000100:00100000:1.0:1787432447.948820:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432447.948876:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609349248 00000100:00100000:1.0:1787432447.948881:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609349248 00000100:00100000:1.0:1787432447.948920:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432447.948928:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609349248:12345-0@lo:13: 00002000:00000024:1.0:1787432447.948950:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432447.948986:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609349248:12345-0@lo:13: Request processed in 59us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432447.948992:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787432447.949017:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787432447.949043:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435ba9f80 x1874258609349248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432447.949059:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609349248:0@lo:13: 00000100:00100000:0.0:1787432447.961547:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432447.965948:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609349376:0@lo:13: 00000100:00100000:1.0:1787432447.966034:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432447.966230:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609349376 00000100:00100000:2.0:1787432447.966239:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609349376 00000100:00100000:2.0:1787432447.966349:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787432447.966360:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609349376:12345-0@lo:13: 00002000:00000024:2.0:1787432447.966384:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432447.966431:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609349376:12345-0@lo:13: Request processed in 73us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432447.966448:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787432447.966512:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787432447.966556:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f85ad80 x1874258609349376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432447.966577:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609349376:0@lo:13: 00010000:00010000:1.0:1787432448.204608:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432448.462336:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609349504:0@lo:400: 00000100:00100000:3.0:1787432448.462414:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432448.462466:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609350016:0@lo:400: 00000100:00100000:3.0:1787432448.462507:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432448.462544:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787432448.462550:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609349632:0@lo:400: 00000100:00100000:3.0:1787432448.462573:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432448.462591:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609350144:0@lo:400: 00000100:00100000:3.0:1787432448.462616:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432448.462647:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609349760:0@lo:400: 00000100:00100000:3.0:1787432448.462673:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432448.463919:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609350272:0@lo:400: 00000100:00100000:3.0:1787432448.463981:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432448.464011:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787432448.464018:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609349888:0@lo:400: 00000100:00100000:3.0:1787432448.464064:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432448.464099:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609350400:0@lo:400: 00000100:00100000:3.0:1787432448.464132:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432448.464273:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609349504 00000100:00100000:3.0:1787432448.464283:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609349504 00000100:00100000:3.0:1787432448.464338:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787432448.464350:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:3641:x1874258609349504:12345-0@lo:400: 00000100:00100000:3.0:1787432448.464422:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:3641:x1874258609349504:12345-0@lo:400: Request processed in 74us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432448.464429:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787432448.464470:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609350016 00000100:00100000:3.0:1787432448.464474:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609350016 00000100:00100000:3.0:1787432448.464537:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609349632 00000100:00100000:3.0:1787432448.464541:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609349632 00000100:00100000:3.0:1787432448.464554:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609350144 00000100:00100000:3.0:1787432448.464558:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609350144 00000100:00100000:3.0:1787432448.464572:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609349760 00000100:00100000:3.0:1787432448.464575:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609349760 00000100:00100000:3.0:1787432448.464584:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609350272 00000100:00100000:3.0:1787432448.464587:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609350272 00000100:00100000:3.0:1787432448.464597:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609350400 00000100:00100000:3.0:1787432448.464600:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609350400 00000100:00100000:3.0:1787432448.464614:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787432448.464621:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609350016:12345-0@lo:400: 00000100:00100000:3.0:1787432448.464660:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609350016:12345-0@lo:400: Request processed in 39us (2152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432448.464674:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787432448.464689:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787432448.465030:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609349888 00000100:00100000:1.0:1787432448.465035:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609349888 00000100:00100000:1.0:1787432448.465067:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787432448.465073:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609349888:12345-0@lo:400: 00000100:00100000:1.0:1787432448.465116:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609349888:12345-0@lo:400: Request processed in 43us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432448.465122:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787432448.466135:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787432448.466157:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609350144:12345-0@lo:400: 00000100:00100000:1.0:1787432448.466252:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609350144:12345-0@lo:400: Request processed in 106us (3634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432448.466259:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787432448.466280:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787432448.466287:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609349760:12345-0@lo:400: 00000100:00100000:1.0:1787432448.466317:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609349760:12345-0@lo:400: Request processed in 31us (3644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432448.466333:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787432448.466346:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787432448.466352:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f85b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609350272:12345-0@lo:400: 00000100:00100000:1.0:1787432448.466386:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f85b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609350272:12345-0@lo:400: Request processed in 33us (2404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432448.466391:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787432448.466402:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787432448.466409:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609350400:12345-0@lo:400: 00000100:00100000:1.0:1787432448.466435:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609350400:12345-0@lo:400: Request processed in 28us (2303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432448.466452:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787432448.467871:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609349632:12345-0@lo:400: 00000100:00100000:3.0:1787432448.467939:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609349632:12345-0@lo:400: Request processed in 3243us (5365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432448.467948:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787432448.468004:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f85b800 x1874258609349632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432448.468021:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609349632:0@lo:400: 00010000:00080000:3.0:1787432448.468036:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f858e00 x1874258609350144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432448.468046:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609350144:0@lo:400: 00000100:00100000:3.0:1787432448.468058:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609349504:0@lo:400: 00010000:00080000:3.0:1787432448.468070:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f85bb80 x1874258609350016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432448.468078:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609350016:0@lo:400: 00000100:00080000:3.0:1787432448.468112:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432448.468117:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432448.468138:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609349888:0@lo:400: 00010000:00080000:3.0:1787432448.468149:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f85b480 x1874258609350400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432448.468158:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609350400:0@lo:400: 00010000:00080000:3.0:1787432448.468188:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f859880 x1874258609349760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432448.468203:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609349760:0@lo:400: 00010000:00080000:3.0:1787432448.468216:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f85ad80 x1874258609350272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432448.468224:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609350272:0@lo:400: 00010000:00010000:0.0:1787432449.227424:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432449.996330:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609350528:0@lo:41: 00000100:00100000:1.0:1787432449.996414:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432449.996696:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609350528 00000100:00100000:2.0:1787432449.996706:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609350528 00000100:00100000:2.0:1787432449.996812:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787432449.996824:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609350528:12345-0@lo:41: 00000004:00000024:2.0:1787432449.996857:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787432450.000009:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609350528:12345-0@lo:41: Request processed in 3176us (3584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432450.000025:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787432450.005602:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609350528:0@lo:41: 00010000:00010000:0.0:1787432450.252912:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787432451.273070:0:9871:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787432451.275610:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432452.299315:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787432452.423035:0:9924:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432452.423669:0:9924:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1787432453.069020:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787432453.069032:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948435a21000 from 39 10000000:01000000:1.0:1787432453.069039:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787432453.069098:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563ea85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432453.069114:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563ea85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432453.069129:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563ea85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432453.069203:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609350656:0@lo:101: 00000100:00100000:1.0:1787432453.069298:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432453.069363:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948406cb50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432453.070264:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609350656 00000100:00100000:2.0:1787432453.070273:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609350656 00000100:00100000:2.0:1787432453.070331:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787432453.070342:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:6511:x1874258609350656:12345-0@lo:101: 00010000:00010000:2.0:1787432453.070358:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432453.070374:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484032e5c00/0xca72b3b33563ea8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ea85 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.070398:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e5c00/0xca72b3b33563ea8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ea85 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.070408:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484032e5c00/0xca72b3b33563ea8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ea85 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.070418:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e5c00, rc 0) 00000100:00100000:2.0:1787432453.070489:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609350656:12345-0@lo:101: Request processed in 149us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.070527:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787432453.070562:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432453.070580:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609350784:0@lo:13: 00000100:00100000:2.0:1787432453.070626:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.070680:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609350656:0@lo:101: 00010000:00010000:2.0:1787432453.070705:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563ea85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ea8c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.070715:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563ea85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ea8c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432453.071453:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609350912:0@lo:501: 00000100:00100000:2.0:1787432453.071492:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.071520:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787432453.072083:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609350784 00000100:00100000:2.0:1787432453.072091:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609350784 00000100:00100000:2.0:1787432453.072138:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787432453.072147:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609350784:12345-0@lo:13: 00002000:00000024:2.0:1787432453.072195:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432453.072251:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609350784:12345-0@lo:13: Request processed in 105us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.072260:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787432453.072308:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484359eb100 x1874258609350784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432453.072327:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609350784:0@lo:13: 00000100:00100000:3.0:1787432453.072522:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609350912 00000100:00100000:3.0:1787432453.072526:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609350912 00000100:00100000:3.0:1787432453.072553:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787432453.072561:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609350912:12345-0@lo:501: 00000100:00100000:3.0:1787432453.072724:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609350912:12345-0@lo:501: Request processed in 163us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432453.072731:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1787432453.072758:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432453.073008:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609351168:0@lo:41: 00000100:00100000:3.0:1787432453.073043:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.073072:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432453.073079:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609351040:0@lo:13: 00000100:00100000:3.0:1787432453.073101:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.073137:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609350912:0@lo:501: 00000100:00100000:3.0:1787432453.073205:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609351296:0@lo:503: 00000100:00100000:3.0:1787432453.073258:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.073280:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484359ec240 going to sleep for 11 seconds 00000100:00100000:3.0:1787432453.073301:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609351168 00000100:00100000:3.0:1787432453.073306:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609351168 00000100:00100000:3.0:1787432453.073343:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787432453.073351:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609351168:12345-0@lo:41: 00000004:00000024:3.0:1787432453.073380:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1787432453.073418:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609351168:12345-0@lo:41: Request processed in 68us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432453.073425:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787432453.073471:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609351168:0@lo:41: 00000100:00100000:3.0:1787432453.073494:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609351040 00000100:00100000:3.0:1787432453.073497:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609351040 00000100:00100000:3.0:1787432453.073528:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787432453.073534:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609351040:12345-0@lo:13: 00002000:00000024:3.0:1787432453.073548:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432453.073579:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609351040:12345-0@lo:13: Request processed in 45us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432453.073585:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787432453.073670:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787432453.073747:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483038c5880 x1874258609351040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432453.073760:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609351040:0@lo:13: 00000100:00100000:3.0:1787432453.073848:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609351296 00000100:00100000:3.0:1787432453.073852:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609351296 00000100:00100000:3.0:1787432453.073870:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787432453.073876:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609351296:12345-0@lo:503: 00000100:00100000:3.0:1787432453.073967:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609351296:12345-0@lo:503: Request processed in 91us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432453.073974:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787432453.074015:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609351296:0@lo:503: 00000100:00100000:0.0:1787432453.092876:0:9947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9947:1874258609351424:0@lo:502: 00000100:00100000:0.0:1787432453.093355:0:9947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432453.093425:0:9947:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb110c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432453.093553:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609351424 00000100:00100000:3.0:1787432453.093560:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609351424 00000100:00100000:3.0:1787432453.093652:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787432453.093662:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:9947:x1874258609351424:12345-0@lo:502: 00000100:00100000:3.0:1787432453.094276:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:9947:x1874258609351424:12345-0@lo:502: Request processed in 613us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432453.094286:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787432453.094408:0:9947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9947:1874258609351424:0@lo:502: 00000100:00100000:2.0:1787432453.094500:0:9947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9947:1874258609351552:0@lo:502: 00000100:00100000:2.0:1787432453.094543:0:9947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.094565:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609351552 00000100:00100000:3.0:1787432453.094569:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609351552 00000100:00100000:3.0:1787432453.094639:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787432453.094648:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:9947:x1874258609351552:12345-0@lo:502: 00000100:00100000:3.0:1787432453.094876:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:9947:x1874258609351552:12345-0@lo:502: Request processed in 229us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432453.094883:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787432453.095463:0:9947:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432453.095552:0:9947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9947:1874258609351552:0@lo:502: 00000040:00080000:3.0:1787432453.095579:0:9947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1787432453.098983:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1787432453.099568:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787432453.099581:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563ea85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ea8c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432453.099594:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563ea85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ea8c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432453.099838:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787432453.099843:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787432453.099846:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787432453.099967:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303012600/0xca72b3b33563ea93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432453.099977:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948303012600/0xca72b3b33563ea93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432453.099990:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948303012600/0xca72b3b33563ea93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432453.100237:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609351680:0@lo:101: 00000100:00100000:3.0:1787432453.100318:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.100361:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484359ecc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432453.100480:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609351680 00000100:00100000:0.0:1787432453.100489:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609351680 00000100:00100000:0.0:1787432453.100545:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787432453.100554:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609351680:12345-0@lo:101: 00010000:00010000:0.0:1787432453.100570:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432453.100589:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948400030000/0xca72b3b33563ea9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ea93 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432453.100615:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948400030000/0xca72b3b33563ea9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ea93 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432453.100625:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948400030000/0xca72b3b33563ea9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ea93 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432453.100634:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948400030000, rc 0) 00000100:00100000:0.0:1787432453.100687:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609351680:12345-0@lo:101: Request processed in 133us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432453.101404:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787432453.102213:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609351680:0@lo:101: 00010000:00010000:3.0:1787432453.102237:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948303012600/0xca72b3b33563ea93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ea9a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432453.102250:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948303012600/0xca72b3b33563ea93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ea9a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432453.102334:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609351808:0@lo:501: 00000100:00100000:3.0:1787432453.102382:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.102414:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484359ecc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432453.102677:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609351808 00000100:00100000:1.0:1787432453.102685:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609351808 00000100:00100000:1.0:1787432453.102733:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787432453.102743:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609351808:12345-0@lo:501: 00000100:00100000:1.0:1787432453.102933:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609351808:12345-0@lo:501: Request processed in 191us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432453.102941:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787432453.102974:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609351808:0@lo:501: 00000100:00100000:1.0:1787432453.103011:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435bab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609351936:0@lo:503: 00000100:00100000:1.0:1787432453.103063:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432453.103128:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948406cb5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432453.103293:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609351936 00000100:00100000:0.0:1787432453.103297:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609351936 00000100:00100000:0.0:1787432453.103330:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787432453.103337:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609351936:12345-0@lo:503: 00000100:00100000:0.0:1787432453.103417:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609351936:12345-0@lo:503: Request processed in 80us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432453.103424:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787432453.103557:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435bab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609351936:0@lo:503: 00000100:00100000:1.0:1787432453.114020:0:9949:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435bab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9949:1874258609352064:0@lo:502: 00000100:00100000:1.0:1787432453.114119:0:9949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432453.114221:0:9949:0:(client.c:2715:ptlrpc_set_wait()) set ffff948406cb50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432453.114299:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609352064 00000100:00100000:3.0:1787432453.114307:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609352064 00000100:00100000:3.0:1787432453.114349:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787432453.114357:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:9949:x1874258609352064:12345-0@lo:502: 00000100:00100000:3.0:1787432453.114486:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:9949:x1874258609352064:12345-0@lo:502: Request processed in 128us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432453.114493:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787432453.114591:0:9949:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435bab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9949:1874258609352064:0@lo:502: 00000020:01000000:1.0:1787432453.114631:0:9949:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432453.114640:0:9949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432453.114642:0:9949:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787432453.114648:0:9949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787432453.114650:0:9949:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787432453.114665:0:9949:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435bab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9949:1874258609352192:0@lo:502: 00000100:00100000:1.0:1787432453.114713:0:9949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432453.114739:0:9949:0:(client.c:2715:ptlrpc_set_wait()) set ffff948406cb50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432453.114787:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609352192 00000100:00100000:3.0:1787432453.114791:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609352192 00000100:00100000:3.0:1787432453.114821:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787432453.114829:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:9949:x1874258609352192:12345-0@lo:502: 00000100:00100000:3.0:1787432453.114891:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:9949:x1874258609352192:12345-0@lo:502: Request processed in 62us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432453.114907:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787432453.115093:0:9949:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435bab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9949:1874258609352192:0@lo:502: 00000020:01000000:1.0:1787432453.115111:0:9949:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432453.115115:0:9949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432453.115117:0:9949:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787432453.115121:0:9949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787432453.115298:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787432453.115329:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787432453.115340:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303012600/0xca72b3b33563ea93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ea9a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432453.115351:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948303012600/0xca72b3b33563ea93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ea9a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432453.115360:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787432453.115363:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94842dfc5000 from 39 10000000:01000000:3.0:1787432453.115366:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787432453.115389:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303012200/0xca72b3b33563eaa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432453.115397:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948303012200/0xca72b3b33563eaa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432453.115405:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948303012200/0xca72b3b33563eaa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432453.115417:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609352320:0@lo:101: 00000100:00100000:3.0:1787432453.115458:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.115483:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484359ec840 going to sleep for 11 seconds 00000100:00100000:1.0:1787432453.115589:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609352320 00000100:00100000:1.0:1787432453.115593:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609352320 00000100:00100000:1.0:1787432453.115634:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787432453.115640:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609352320:12345-0@lo:101: 00010000:00010000:1.0:1787432453.115649:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432453.115661:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948401682200/0xca72b3b33563eaa8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563eaa1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432453.115682:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948401682200/0xca72b3b33563eaa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563eaa1 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432453.115701:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948401682200/0xca72b3b33563eaa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563eaa1 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432453.115709:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948401682200, rc 0) 00000100:00100000:1.0:1787432453.115739:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609352320:12345-0@lo:101: Request processed in 99us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432453.115745:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787432453.115858:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609352320:0@lo:101: 00010000:00010000:3.0:1787432453.115870:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948303012200/0xca72b3b33563eaa1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eaa8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432453.115879:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948303012200/0xca72b3b33563eaa1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563eaa8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432453.115944:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609352448:0@lo:501: 00000100:00100000:3.0:1787432453.115971:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.115998:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484359ec840 going to sleep for 11 seconds 00000100:00100000:2.0:1787432453.116043:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609352448 00000100:00100000:2.0:1787432453.116048:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609352448 00000100:00100000:2.0:1787432453.116080:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787432453.116088:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609352448:12345-0@lo:501: 00000100:00100000:2.0:1787432453.116222:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609352448:12345-0@lo:501: Request processed in 135us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.116228:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787432453.116386:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609352448:0@lo:501: 00000100:00100000:3.0:1787432453.116408:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609352576:0@lo:503: 00000100:00100000:3.0:1787432453.116453:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.116477:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484359ec840 going to sleep for 11 seconds 00000100:00100000:2.0:1787432453.116517:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609352576 00000100:00100000:2.0:1787432453.116521:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609352576 00000100:00100000:2.0:1787432453.116553:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787432453.116559:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609352576:12345-0@lo:503: 00000100:00100000:2.0:1787432453.116640:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609352576:12345-0@lo:503: Request processed in 80us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.116646:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787432453.116800:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609352576:0@lo:503: 00000100:00100000:3.0:1787432453.118472:0:9950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9950:1874258609352704:0@lo:502: 00000100:00100000:3.0:1787432453.118549:0:9950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.118598:0:9950:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484359ecf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432453.118822:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609352704 00000100:00100000:2.0:1787432453.118829:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609352704 00000100:00100000:2.0:1787432453.118881:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787432453.118891:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:9950:x1874258609352704:12345-0@lo:502: 00000100:00100000:2.0:1787432453.119010:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:9950:x1874258609352704:12345-0@lo:502: Request processed in 121us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.119019:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787432453.120102:0:9950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9950:1874258609352704:0@lo:502: 00000100:00100000:3.0:1787432453.120325:0:9950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9950:1874258609352832:0@lo:502: 00000100:00100000:3.0:1787432453.120400:0:9950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.120448:0:9950:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484359ecf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432453.121156:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609352832 00000100:00100000:2.0:1787432453.121178:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609352832 00000100:00100000:2.0:1787432453.121233:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787432453.121244:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:9950:x1874258609352832:12345-0@lo:502: 00000100:00100000:2.0:1787432453.121407:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:9950:x1874258609352832:12345-0@lo:502: Request processed in 164us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.121415:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787432453.121432:0:9950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9950:1874258609352832:0@lo:502: 00000040:00080000:3.0:1787432453.121466:0:9950:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787432453.123958:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787432453.124009:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787432453.124022:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303012200/0xca72b3b33563eaa1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eaa8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.124034:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948303012200/0xca72b3b33563eaa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eaa8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432453.124045:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787432453.124048:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94842dfc5000 from 6 10000000:01000000:2.0:1787432453.124051:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787432453.124104:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563eaaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.124113:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563eaaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.124125:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563eaaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432453.124421:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609352960:0@lo:101: 00000100:00100000:2.0:1787432453.124506:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.124546:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432453.124618:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609352960 00000100:00100000:0.0:1787432453.124627:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609352960 00000100:00100000:0.0:1787432453.124686:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787432453.124846:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609352960:12345-0@lo:101: 00010000:00010000:0.0:1787432453.124860:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432453.124876:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948400031c00/0xca72b3b33563eab6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563eaaf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432453.124901:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948400031c00/0xca72b3b33563eab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563eaaf expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432453.124927:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948400031c00/0xca72b3b33563eab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563eaaf expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432453.124936:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948400031c00, rc 0) 00000100:00100000:0.0:1787432453.124993:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:6511:x1874258609352960:12345-0@lo:101: Request processed in 151us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432453.125759:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609352960:0@lo:101: 00010000:00010000:1.0:1787432453.125779:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563eaaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eab6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432453.125801:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563eaaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563eab6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432453.125866:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435bab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609353088:0@lo:256: 00000100:00100000:1.0:1787432453.125922:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432453.125955:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948406cb5300 going to sleep for 11 seconds 00000100:00100000:2.0:1787432453.128301:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609353088 00000100:00100000:2.0:1787432453.128318:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609353088 00000100:00100000:2.0:1787432453.128368:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787432453.128380:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609353088:12345-0@lo:256: 20000000:01000000:2.0:1787432453.128415:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787432453.128434:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787432453.128447:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787432453.131853:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609353088:12345-0@lo:256: Request processed in 3467us (5922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.131868:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787432453.132061:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435bab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609353088:0@lo:256: 10000000:01000000:2.0:1787432453.132134:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787432453.132146:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563eaaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eab6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.132158:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563eaaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eab6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432453.132187:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787432453.132190:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1787432453.132193:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787432453.132226:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563eabd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.132234:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563eabd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.132244:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563eabd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432453.132264:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609353216:0@lo:101: 00000100:00100000:2.0:1787432453.132302:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.132330:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432453.132357:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609353216 00000100:00100000:2.0:1787432453.132363:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609353216 00000100:00100000:2.0:1787432453.132398:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787432453.132406:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609353216:12345-0@lo:101: 00010000:00010000:2.0:1787432453.132418:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432453.132429:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484032e4a00/0xca72b3b33563eac4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563eabd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.132465:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e4a00/0xca72b3b33563eac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563eabd expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.132476:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484032e4a00/0xca72b3b33563eac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563eabd expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.132484:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e4a00, rc 0) 00000100:00100000:2.0:1787432453.132514:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609353216:12345-0@lo:101: Request processed in 108us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.132520:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787432453.132548:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609353216:0@lo:101: 00010000:00010000:2.0:1787432453.132559:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563eabd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eac4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.132568:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563eabd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563eac4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432453.132630:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609353344:0@lo:501: 00000100:00100000:2.0:1787432453.132655:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.132668:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432453.132680:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609353344 00000100:00100000:2.0:1787432453.132689:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609353344 00000100:00100000:2.0:1787432453.132714:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787432453.132720:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609353344:12345-0@lo:501: 00000100:00100000:2.0:1787432453.132830:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609353344:12345-0@lo:501: Request processed in 109us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.132836:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787432453.132865:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609353344:0@lo:501: 00000100:00100000:2.0:1787432453.132903:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609353472:0@lo:503: 00000100:00100000:2.0:1787432453.132942:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.132955:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432453.132966:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609353472 00000100:00100000:2.0:1787432453.132969:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609353472 00000100:00100000:2.0:1787432453.132988:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787432453.132994:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609353472:12345-0@lo:503: 00000100:00100000:2.0:1787432453.133070:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609353472:12345-0@lo:503: Request processed in 75us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.133077:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787432453.133116:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609353472:0@lo:503: 00000100:00100000:2.0:1787432453.133334:0:9952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9952:1874258609353600:0@lo:502: 00000100:00100000:2.0:1787432453.133368:0:9952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.133385:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609353600 00000100:00100000:2.0:1787432453.133388:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609353600 00000100:00100000:2.0:1787432453.133406:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787432453.133411:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:9952:x1874258609353600:12345-0@lo:502: 00000100:00100000:2.0:1787432453.133493:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:9952:x1874258609353600:12345-0@lo:502: Request processed in 81us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.133508:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787432453.133535:0:9952:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432453.133546:0:9952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9952:1874258609353600:0@lo:502: 00000020:01000000:2.0:1787432453.133567:0:9952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787432453.133574:0:9952:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787432453.133580:0:9952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432453.133582:0:9952:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787432453.133597:0:9952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787432453.133601:0:9952:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.124@tcp to nid 0x20000c0a8cc7c (192.168.204.124@tcp) 00000020:01000000:2.0:1787432453.133624:0:9952:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787432453.133626:0:9952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787432453.133641:0:9952:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9484349d3370) 00000020:00000080:2.0:1787432453.133663:0:9952:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1787432453.133668:0:9952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787432453.133753:0:9952:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787432453.133760:0:9952:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787432453.133768:0:9952:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xca72b3b33563ead2 00010000:00080000:2.0:1787432453.133795:0:9952:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94843f86c800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.124@tcp at head 00010000:00010000:2.0:1787432453.134030:0:9952:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1787432453.134155:0:9952:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787432453.134187:0:9952:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1787432453.136427:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000040:00080000:2.0:1787432453.140412:0:9952:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432453.140747:0:9952:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432453.140889:0:9952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787432453.140995:0:9952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787432453.144257:0:9953:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787432453.144266:0:9953:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787432453.145150:0:9952:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787432453.145196:0:9952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787432453.145239:0:9952:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787432453.145273:0:9952:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b33563ead9 00000100:00080000:3.0:1787432453.145289:0:9952:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787432453.145297:0:9952:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94843f86c800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432453.145353:0:9952:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9483038c5880 x1874258609353728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432453.145379:0:9952:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787432453.145456:0:9952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432453.145461:0:9952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432453.145463:0:9952:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787432453.145466:0:9952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432453.145470:0:9952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432453.145472:0:9952:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787432453.145475:0:9952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787432453.145477:0:9952:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787432453.145508:0:9952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9952:1874258609353856:0@lo:502: 00000100:00100000:3.0:1787432453.145593:0:9952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432453.145832:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609354112:0@lo:400: 00000100:00100000:1.0:1787432453.145877:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432453.145919:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609354624:0@lo:400: 00000100:00100000:1.0:1787432453.145941:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432453.145963:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787432453.145968:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609353984:0@lo:400: 00000100:00100000:1.0:1787432453.145990:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432453.146007:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609354496:0@lo:400: 00000100:00100000:1.0:1787432453.146028:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432453.146063:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609354112 00000100:00100000:1.0:1787432453.146074:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609354112 00000100:00100000:1.0:1787432453.146122:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609354624 00000100:00100000:1.0:1787432453.146125:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609354624 00000100:00100000:1.0:1787432453.146151:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609353984 00000100:00100000:1.0:1787432453.146153:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609353984 00000100:00100000:1.0:1787432453.146183:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609354496 00000100:00100000:1.0:1787432453.146185:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609354496 00000100:00100000:1.0:1787432453.146203:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787432453.146212:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609354112:12345-0@lo:400: 00000100:00100000:1.0:1787432453.146282:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609354112:12345-0@lo:400: Request processed in 70us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432453.146291:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787432453.146310:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787432453.146318:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609354624:12345-0@lo:400: 00000100:00100000:1.0:1787432453.146347:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609354624:12345-0@lo:400: Request processed in 31us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432453.146353:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787432453.146363:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787432453.146368:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609353984:12345-0@lo:400: 00000100:00100000:1.0:1787432453.146407:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609353984:12345-0@lo:400: Request processed in 39us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432453.146413:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787432453.146423:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787432453.146428:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609354496:12345-0@lo:400: 00000100:00100000:1.0:1787432453.146461:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609354496:12345-0@lo:400: Request processed in 34us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432453.146466:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1787432453.146501:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435bab100 x1874258609353984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432453.146513:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609353984:0@lo:400: 00010000:00080000:1.0:1787432453.146522:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948301dbd180 x1874258609354496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432453.146530:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609354496:0@lo:400: 00010000:00080000:1.0:1787432453.146547:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435ba9180 x1874258609354112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432453.146553:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609354112:0@lo:400: 00010000:00080000:1.0:1787432453.146561:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948301dbed80 x1874258609354624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432453.146567:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609354624:0@lo:400: 00000100:00100000:3.0:1787432453.146828:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609354368:0@lo:400: 00000100:00100000:3.0:1787432453.146857:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.146886:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787432453.146893:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609354240:0@lo:400: 00000100:00100000:3.0:1787432453.146920:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.146939:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609354752:0@lo:400: 00000100:00100000:3.0:1787432453.146959:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.146981:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609354368 00000100:00100000:3.0:1787432453.146984:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609354368 00000100:00100000:3.0:1787432453.147009:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609354752 00000100:00100000:3.0:1787432453.147012:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609354752 00000100:00100000:3.0:1787432453.147027:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787432453.147034:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609354368:12345-0@lo:400: 00000100:00100000:3.0:1787432453.147068:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609354368:12345-0@lo:400: Request processed in 35us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432453.147085:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787432453.147098:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787432453.147105:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609354752:12345-0@lo:400: 00000100:00100000:2.0:1787432453.147236:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609353728:0@lo:8: 00000100:00100000:2.0:1787432453.147271:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.147319:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609353728 00000100:00100000:2.0:1787432453.147323:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609353728 00000100:00100000:2.0:1787432453.147362:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787432453.147367:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1874258609353728:12345-0@lo:8: 00010000:00080000:2.0:1787432453.147391:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:2.0:1787432453.147419:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b33563eae0 00002000:00100000:2.0:1787432453.147433:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff94843f868000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787432453.147450:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1787432453.147454:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787432453.147516:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787432453.147787:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787432453.147816:0:8432:0:(import.c:65:import_set_state_nolock()) ffff94843f86e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432453.147859:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1874258609353728:12345-0@lo:8: Request processed in 490us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.147866:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787432453.147899:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483038c5880 x1874258609353728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787432463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432453.147909:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787432453.147916:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787432453.147922:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787432453.147927:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787432453.147929:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843f86c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787432453.147938:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787432453.147943:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609353728:0@lo:8: 00000100:00100000:2.0:1787432453.147989:0:9954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9954:1874258609354880:0@lo:700: 00000100:00100000:2.0:1787432453.148015:0:9954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.148033:0:9954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f36c0 going to sleep for 11 seconds 00000004:00080000:1.0:1787432453.148205:0:9953:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787432453.148265:0:9953:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 264240099555ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787432453.148272:0:9953:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787432453.148729:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609354752:12345-0@lo:400: Request processed in 1619us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432453.148738:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787432453.148767:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432453.148772:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432453.148787:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609353856 00000100:00100000:3.0:1787432453.148792:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609353856 00000100:00100000:3.0:1787432453.148837:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787432453.148845:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:9952:x1874258609353856:12345-0@lo:502: 00000100:00100000:3.0:1787432453.148974:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:9952:x1874258609353856:12345-0@lo:502: Request processed in 129us (3381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432453.148980:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787432453.149021:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609354240 00000100:00100000:3.0:1787432453.149025:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609354240 00000100:00100000:3.0:1787432453.149053:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787432453.149059:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609354240:12345-0@lo:400: 00000100:00100000:3.0:1787432453.149105:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609354240:12345-0@lo:400: Request processed in 46us (2184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432453.149112:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787432453.151848:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609354240:0@lo:400: 00010000:00080000:3.0:1787432453.151876:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948301dbf100 x1874258609354752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432453.151889:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609354752:0@lo:400: 00010000:00080000:3.0:1787432453.151924:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948301dbc000 x1874258609354368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432453.151933:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609354368:0@lo:400: 00000100:00100000:3.0:1787432453.151995:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609354880 00000100:00100000:3.0:1787432453.152004:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609354880 00000100:00100000:3.0:1787432453.152073:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787432453.152085:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9954:x1874258609354880:12345-0@lo:700: 00000100:00100000:3.0:1787432453.152161:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8439:1874258609355008:0@lo:700: 00000100:00100000:3.0:1787432453.152234:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.152261:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484359eca80 going to sleep for 11 seconds 00000100:00080000:3.0:1787432453.152277:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432453.152293:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609355008 00000100:00100000:3.0:1787432453.152296:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609355008 00000100:00100000:3.0:1787432453.152320:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787432453.152326:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8439:x1874258609355008:12345-0@lo:700: 00000100:00100000:3.0:1787432453.152434:0:9952:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484359ecc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432453.152460:0:9952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9952:1874258609353856:0@lo:502: 00000020:01000000:3.0:1787432453.152489:0:9952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432453.152496:0:9952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432453.152502:0:9952:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787432453.152507:0:9952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:3.0:1787432453.152581:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 00000004:00080000:2.0:1787432453.155785:0:7445:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 10000000:01000000:3.0:1787432453.156384:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787432453.156401:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563eabd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eac4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432453.156413:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563eabd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eac4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432453.156431:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787432453.156433:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948411b1c000 from 39 10000000:01000000:3.0:1787432453.157920:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787432453.157989:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303013c00/0xca72b3b33563eae7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432453.158000:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948303013c00/0xca72b3b33563eae7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432453.158013:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948303013c00/0xca72b3b33563eae7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432453.158041:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609355136:0@lo:101: 00000100:00100000:3.0:1787432453.158148:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.158213:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484359ec840 going to sleep for 11 seconds 00000100:00100000:0.0:1787432453.158326:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609355136 00000100:00100000:0.0:1787432453.158336:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609355136 00000100:00100000:0.0:1787432453.158401:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787432453.158411:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609355136:12345-0@lo:101: 00010000:00010000:0.0:1787432453.158426:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432453.158454:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948400031600/0xca72b3b33563eaee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563eae7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432453.158479:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948400031600/0xca72b3b33563eaee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563eae7 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432453.158491:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948400031600/0xca72b3b33563eaee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563eae7 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432453.158500:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948400031600, rc 0) 00000100:00100000:0.0:1787432453.158542:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609355136:12345-0@lo:101: Request processed in 133us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432453.158549:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787432453.159283:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609355136:0@lo:101: 00010000:00010000:2.0:1787432453.159303:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948303013c00/0xca72b3b33563eae7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eaee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.159313:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948303013c00/0xca72b3b33563eae7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563eaee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432453.159398:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609355264:0@lo:501: 00000100:00100000:2.0:1787432453.159431:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.159461:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f3480 going to sleep for 11 seconds 00000100:00100000:0.0:1787432453.159559:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609355264 00000100:00100000:0.0:1787432453.159564:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609355264 00000100:00100000:0.0:1787432453.159590:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787432453.159614:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609355264:12345-0@lo:501: 00000100:00100000:0.0:1787432453.159725:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609355264:12345-0@lo:501: Request processed in 123us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432453.159733:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787432453.159778:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609355264:0@lo:501: 00000100:00100000:0.0:1787432453.159808:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609355392:0@lo:503: 00000100:00100000:0.0:1787432453.159845:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432453.159859:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb11a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432453.159874:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609355392 00000100:00100000:0.0:1787432453.159878:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609355392 00000100:00100000:0.0:1787432453.159901:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787432453.159908:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609355392:12345-0@lo:503: 00000100:00100000:0.0:1787432453.159984:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609355392:12345-0@lo:503: Request processed in 76us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432453.159991:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787432453.160037:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609355392:0@lo:503: 40000000:02000000:0.0:1787432453.163296:0:6520:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1787432453.174218:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8439:x1874258609355008:12345-0@lo:700: Request processed in 21884us (21975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432453.174235:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787432453.174806:0:8439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483038c5180 x1874258609355008/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787432469 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432453.174823:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8439:1874258609355008:0@lo:700: 40000000:02000000:1.0:1787432453.174835:0:8439:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:1.0:1787432453.184612:0:9955:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9955:1874258609355520:0@lo:502: 00000100:00100000:1.0:1787432453.184702:0:9955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432453.184752:0:9955:0:(client.c:2715:ptlrpc_set_wait()) set ffff948406cb5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432453.185497:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609355520 00000100:00100000:0.0:1787432453.185505:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609355520 00000100:00100000:0.0:1787432453.185555:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787432453.185565:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:9955:x1874258609355520:12345-0@lo:502: 00000100:00100000:0.0:1787432453.185743:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:9955:x1874258609355520:12345-0@lo:502: Request processed in 179us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432453.185758:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787432453.186507:0:9955:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9955:1874258609355520:0@lo:502: 00000100:00100000:2.0:1787432453.186573:0:9955:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9955:1874258609355648:0@lo:502: 00000100:00100000:2.0:1787432453.186632:0:9955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.186661:0:9955:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f3480 going to sleep for 11 seconds 00000100:00100000:0.0:1787432453.186867:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609355648 00000100:00100000:0.0:1787432453.186873:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609355648 00000100:00100000:0.0:1787432453.186922:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787432453.186932:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:9955:x1874258609355648:12345-0@lo:502: 00000100:00100000:0.0:1787432453.187047:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:9955:x1874258609355648:12345-0@lo:502: Request processed in 116us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432453.187055:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787432453.187098:0:9955:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9955:1874258609355648:0@lo:502: 00000040:00080000:0.0:1787432453.187118:0:9955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1787432453.187213:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1787432453.187241:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787432453.187252:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303013c00/0xca72b3b33563eae7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eaee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432453.187264:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948303013c00/0xca72b3b33563eae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eaee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432453.187274:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787432453.187276:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff948411b1c000 from 6 10000000:01000000:0.0:1787432453.187279:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787432453.187307:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948400031000/0xca72b3b33563eaf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432453.187315:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948400031000/0xca72b3b33563eaf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432453.187323:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948400031000/0xca72b3b33563eaf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432453.187345:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609355776:0@lo:101: 00000100:00100000:0.0:1787432453.187374:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432453.187389:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb11780 going to sleep for 11 seconds 00000100:00100000:0.0:1787432453.187408:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609355776 00000100:00100000:0.0:1787432453.187412:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609355776 00000100:00100000:0.0:1787432453.187430:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787432453.187447:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609355776:12345-0@lo:101: 00010000:00010000:0.0:1787432453.187455:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432453.187468:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484013fd600/0xca72b3b33563eafc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563eaf5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432453.187488:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fd600/0xca72b3b33563eafc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563eaf5 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432453.187497:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484013fd600/0xca72b3b33563eafc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563eaf5 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432453.187506:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fd600, rc 0) 00000100:00100000:0.0:1787432453.187535:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609355776:12345-0@lo:101: Request processed in 99us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432453.187541:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787432453.187569:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609355776:0@lo:101: 00010000:00010000:0.0:1787432453.187580:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948400031000/0xca72b3b33563eaf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eafc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432453.187589:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948400031000/0xca72b3b33563eaf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563eafc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432453.188481:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609355904:0@lo:256: 00000100:00100000:0.0:1787432453.188526:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432453.188565:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb11780 going to sleep for 11 seconds 00000100:00100000:2.0:1787432453.189115:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609355904 00000100:00100000:2.0:1787432453.189126:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609355904 00000100:00100000:2.0:1787432453.189206:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787432453.189218:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609355904:12345-0@lo:256: 20000000:01000000:2.0:1787432453.189242:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787432453.189268:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787432453.189271:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787432453.189382:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609355904:12345-0@lo:256: Request processed in 166us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.189389:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787432453.189429:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609355904:0@lo:256: 10000000:01000000:2.0:1787432453.189487:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787432453.189495:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948400031000/0xca72b3b33563eaf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eafc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.189509:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948400031000/0xca72b3b33563eaf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eafc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432453.189518:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787432453.189520:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787432453.189522:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787432453.189552:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563eb03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.189559:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563eb03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.189567:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563eb03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432453.189581:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609356032:0@lo:101: 00000100:00100000:2.0:1787432453.189622:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.189637:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bbe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432453.189652:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609356032 00000100:00100000:2.0:1787432453.189655:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609356032 00000100:00100000:2.0:1787432453.189672:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787432453.189678:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609356032:12345-0@lo:101: 00010000:00010000:2.0:1787432453.189687:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432453.189708:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484032e5600/0xca72b3b33563eb0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563eb03 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.189728:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e5600/0xca72b3b33563eb0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563eb03 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.189749:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484032e5600/0xca72b3b33563eb0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563eb03 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.189758:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e5600, rc 0) 00000100:00100000:2.0:1787432453.189785:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609356032:12345-0@lo:101: Request processed in 107us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.189791:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787432453.189819:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609356032:0@lo:101: 00010000:00010000:2.0:1787432453.189829:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563eb03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eb0a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.189839:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563eb03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563eb0a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432453.189891:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609356160:0@lo:501: 00000100:00100000:2.0:1787432453.189915:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.189928:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bbe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432453.189939:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609356160 00000100:00100000:2.0:1787432453.189942:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609356160 00000100:00100000:2.0:1787432453.189958:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787432453.189964:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609356160:12345-0@lo:501: 00000100:00100000:2.0:1787432453.190090:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609356160:12345-0@lo:501: Request processed in 125us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.190097:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787432453.190125:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609356160:0@lo:501: 00000100:00100000:2.0:1787432453.190153:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609356288:0@lo:503: 00000100:00100000:2.0:1787432453.190230:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.190243:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bbe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432453.190255:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609356288 00000100:00100000:2.0:1787432453.190259:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609356288 00000100:00100000:2.0:1787432453.190280:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787432453.190286:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609356288:12345-0@lo:503: 00000100:00100000:2.0:1787432453.190365:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609356288:12345-0@lo:503: Request processed in 78us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.190371:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787432453.190410:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609356288:0@lo:503: 00000100:00100000:3.0:1787432453.199674:0:9956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9956:1874258609356416:0@lo:502: 00000100:00100000:3.0:1787432453.199897:0:9956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.199988:0:9956:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484359ec600 going to sleep for 11 seconds 00000100:00100000:2.0:1787432453.204598:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609356416 00000100:00100000:2.0:1787432453.204975:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609356416 00000100:00100000:2.0:1787432453.206941:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787432453.206965:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948406122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:9956:x1874258609356416:12345-0@lo:502: 00000100:00100000:2.0:1787432453.207195:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948406122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:9956:x1874258609356416:12345-0@lo:502: Request processed in 240us (7298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.207204:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787432453.207485:0:9956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9956:1874258609356416:0@lo:502: 00000020:01000000:3.0:1787432453.207527:0:9956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787432453.207536:0:9956:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787432453.207543:0:9956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432453.207545:0:9956:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787432453.207551:0:9956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787432453.207555:0:9956:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.124@tcp to nid 0x20000c0a8cc7c (192.168.204.124@tcp) 00000020:01000000:3.0:1787432453.207582:0:9956:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787432453.207585:0:9956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787432453.207621:0:9956:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9483030f3370) 00000020:00000080:3.0:1787432453.207645:0:9956:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1787432453.207652:0:9956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787432453.207748:0:9956:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787432453.207754:0:9956:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787432453.207761:0:9956:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33563eb18 00010000:00080000:3.0:1787432453.207790:0:9956:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9484359a4800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.124@tcp at head 00010000:00010000:3.0:1787432453.208048:0:9956:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1787432453.208229:0:9956:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787432453.208243:0:9956:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787432453.208425:0:9956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787432453.208578:0:9956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787432453.208705:0:9956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787432453.208793:0:9956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787432453.221928:0:9957:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787432453.221941:0:9957:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000001:00100000:2.0:1787432453.223665:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1787432453.224191:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9954:x1874258609354880:12345-0@lo:700: Request processed in 72102us (76168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432453.224204:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:00000080:3.0:1787432453.224586:0:9956:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787432453.224609:0:9956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787432453.224664:0:9956:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787432453.224820:0:9956:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b33563eb1f 00000100:00080000:3.0:1787432453.224831:0:9956:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787432453.224838:0:9956:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9484359a4800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432453.224881:0:9956:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9483038c6300 x1874258609356544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432453.224906:0:9956:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787432453.224964:0:9956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432453.224968:0:9956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432453.224979:0:9956:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787432453.224983:0:9956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432453.224987:0:9956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432453.224989:0:9956:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787432453.224992:0:9956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787432453.224994:0:9956:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787432453.225025:0:9956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9956:1874258609356672:0@lo:502: 00000100:00100000:3.0:1787432453.225085:0:9956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.225117:0:9956:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484034f0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787432453.225848:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609356544:0@lo:8: 00000100:00100000:2.0:1787432453.225901:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787432453.225977:0:9954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484359e8700 x1874258609354880/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787432469 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432453.225991:0:9954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9954:1874258609354880:0@lo:700: 00000100:00100000:1.0:1787432453.226398:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609356672 00000100:00100000:1.0:1787432453.226407:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609356672 00000100:00100000:1.0:1787432453.226476:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787432453.226487:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948406120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:9956:x1874258609356672:12345-0@lo:502: 00000100:00100000:1.0:1787432453.226630:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948406120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:9956:x1874258609356672:12345-0@lo:502: Request processed in 145us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432453.226638:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787432453.226713:0:9956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:9956:1874258609356672:0@lo:502: 00000020:01000000:3.0:1787432453.226744:0:9956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432453.226751:0:9956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432453.226753:0:9956:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787432453.226758:0:9956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1787432453.226831:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1787432453.226855:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787432453.226866:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563eb03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eb0a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.226883:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563eb03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eb0a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432453.226974:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787432453.226977:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9484336199b8 from 1 10000000:01000000:2.0:1787432453.226980:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787432453.227015:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563eb26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.227023:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563eb26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432453.227032:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563eb26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432453.227048:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609356800:0@lo:101: 00000100:00100000:0.0:1787432453.227567:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609356544 00000100:00100000:0.0:1787432453.227573:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609356544 00000100:00100000:0.0:1787432453.227672:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787432453.227680:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1874258609356544:12345-0@lo:8: 00010000:00080000:0.0:1787432453.227755:0:8431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:0.0:1787432453.227787:0:8431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b33563eb2d 00002000:00100000:0.0:1787432453.227801:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9483032fd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787432453.227805:0:8431:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787432453.227808:0:8431:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787432453.227849:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1787432453.227879:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1787432453.227880:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bbee40 going to sleep for 11 seconds 00000100:00080000:0.0:1787432453.227903:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9483032fa800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432453.227953:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1874258609356544:12345-0@lo:8: Request processed in 273us (2051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432453.227960:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787432453.228008:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483038c6300 x1874258609356544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787432463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432453.228017:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787432453.228024:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787432453.228031:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787432453.228037:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787432453.228039:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484359a4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787432453.228053:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787432453.228069:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609356544:0@lo:8: 00000004:00080000:0.0:1787432453.228092:0:9957:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787432453.228141:0:9957:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 264319975609ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787432453.228147:0:9957:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787432453.228564:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609356800 00000100:00100000:3.0:1787432453.228570:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609356800 00000100:00100000:3.0:1787432453.229063:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787432453.229075:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948406122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609356800:12345-0@lo:101: 00010000:00010000:3.0:1787432453.229086:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432453.229103:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303013800/0xca72b3b33563eb34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563eb26 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432453.229128:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303013800/0xca72b3b33563eb34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563eb26 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432453.229139:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303013800/0xca72b3b33563eb34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563eb26 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432453.229147:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303013800, rc 0) 00000100:00100000:3.0:1787432453.229223:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948406122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609356800:12345-0@lo:101: Request processed in 152us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432453.229237:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787432453.233575:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609356800:0@lo:101: 00010000:00010000:3.0:1787432453.233665:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563eb26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eb34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432453.233680:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563eb26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563eb34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432453.233834:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609356928:0@lo:501: 00000100:00100000:3.0:1787432453.233907:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.233948:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484164ba540 going to sleep for 11 seconds 00000100:00100000:3.0:1787432453.233975:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609356928 00000100:00100000:3.0:1787432453.233981:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609356928 00000100:00100000:3.0:1787432453.234034:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787432453.234042:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609356928:12345-0@lo:501: 00000100:00100000:3.0:1787432453.234128:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609356928:12345-0@lo:501: Request processed in 86us (220us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787432453.234280:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787432453.234321:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609356928:0@lo:501: 00000004:00080000:2.0:1787432453.234350:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 10000000:01000000:3.0:1787432453.234361:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787432453.234368:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563eb26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eb34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432453.234376:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563eb26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eb34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787432453.246144:0:9954:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787432453.246204:0:9954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9954:1874258609357184:0@lo:7: 00000100:00100000:1.0:1787432453.246205:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609357056:0@lo:13: 00000100:00100000:1.0:1787432453.247369:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.247518:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609357056 00000100:00100000:2.0:1787432453.247530:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609357056 00000100:00100000:2.0:1787432453.247587:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787432453.247600:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609357056:12345-0@lo:13: 00002000:00000024:2.0:1787432453.247632:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1787432453.247707:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609357056:12345-0@lo:13: Request processed in 109us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.247714:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787432453.247922:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483038c6680 x1874258609357056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432453.247948:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609357056:0@lo:13: 00000100:00100000:3.0:1787432453.252959:0:9954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.253028:0:9954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484164ba540 going to sleep for 11 seconds 00000100:00100000:1.0:1787432453.254995:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609357184 00000100:00100000:1.0:1787432453.255010:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609357184 00000100:00100000:1.0:1787432453.255083:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787432453.258485:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9954:x1874258609357184:12345-0@lo:7: 00000100:00100000:2.0:1787432453.259584:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609357312:0@lo:13: 00000100:00100000:2.0:1787432453.259671:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.264484:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609357312 00000100:00100000:2.0:1787432453.264503:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609357312 00000100:00100000:2.0:1787432453.264587:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432453.264597:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609357312:12345-0@lo:13: 00002000:00000024:2.0:1787432453.264627:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1787432453.265252:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609357312:12345-0@lo:13: Request processed in 654us (5590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432453.265263:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787432453.265325:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484359eb100 x1874258609357312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432453.265349:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609357312:0@lo:13: 00000004:00080000:2.0:1787432453.265376:0:9958:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787432453.265407:0:9958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9958:1874258609357440:0@lo:7: 00000100:00100000:2.0:1787432453.265453:0:9958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.265482:0:9958:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bbe000 going to sleep for 11 seconds 00000100:00080000:2.0:1787432453.266251:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432453.269965:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609357440 00000100:00100000:0.0:1787432453.269978:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609357440 00000100:00100000:0.0:1787432453.270062:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787432453.270074:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9958:x1874258609357440:12345-0@lo:7: 00002000:00080000:1.0:1787432453.281419:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1787432453.281429:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787432453.281581:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9954:x1874258609357184:12345-0@lo:7: Request processed in 23117us (28623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432453.281592:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787432453.289124:0:9954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483038c6a00 x1874258609357184/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787432469 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432453.289471:0:9954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9954:1874258609357184:0@lo:7: 00000004:00080000:2.0:1787432453.289490:0:9954:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787432453.289914:0:9954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359ea680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9954:1874258609357568:0@lo:5: 00000100:00100000:2.0:1787432453.290007:0:9954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.290078:0:9954:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bbe300 going to sleep for 11 seconds 00002000:00080000:0.0:1787432453.290246:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00000100:00100000:1.0:1787432453.290251:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609357568 00002000:00080000:0.0:1787432453.290254:0:8431:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787432453.290260:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609357568 00000100:00100000:1.0:1787432453.290313:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787432453.290314:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9958:x1874258609357440:12345-0@lo:7: Request processed in 20242us (24861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432453.290322:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787432453.290324:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9954:x1874258609357568:12345-0@lo:5: 00002000:00080000:1.0:1787432453.290361:0:8806:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1787432453.290393:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9954:x1874258609357568:12345-0@lo:5: Request processed in 71us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432453.290398:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787432453.290667:0:9958:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484359eb100 x1874258609357440/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787432469 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432453.290694:0:9958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9958:1874258609357440:0@lo:7: 00000004:00080000:2.0:1787432453.290704:0:9958:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787432453.290746:0:9958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9958:1874258609357696:0@lo:5: 00000100:00100000:2.0:1787432453.290775:0:9958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.290799:0:9958:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bbe000 going to sleep for 11 seconds 00010000:00080000:2.0:1787432453.290819:0:9954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484359ea680 x1874258609357568/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787432469 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432453.290828:0:9954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359ea680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9954:1874258609357568:0@lo:5: 00000004:00080000:2.0:1787432453.290838:0:9954:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787432453.290862:0:9954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303799180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9954:1874258609357824:0@lo:5: 00000100:00100000:2.0:1787432453.290882:0:9954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.291062:0:9954:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bbe300 going to sleep for 11 seconds 00000100:00100000:0.0:1787432453.297043:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609357696 00000100:00100000:0.0:1787432453.297065:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609357696 00000100:00100000:3.0:1787432453.297239:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609357824 00000100:00100000:3.0:1787432453.297243:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609357824 00000100:00100000:1.0:1787432453.305481:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432453.305565:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9958:x1874258609357696:12345-0@lo:5: 00002000:00080000:2.0:1787432453.305603:0:8432:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787432453.305607:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787432453.308057:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787432453.308076:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9954:x1874258609357824:12345-0@lo:5: 00002000:00080000:3.0:1787432453.308117:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00010000:00010000:0.0:1787432453.324223:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432453.327087:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9954:x1874258609357824:12345-0@lo:5: Request processed in 19006us (36191us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787432453.327104:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787432453.327212:0:9954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303799180 x1874258609357824/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787432469 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432453.327233:0:9954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303799180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9954:1874258609357824:0@lo:5: 00000004:00080000:3.0:1787432453.327248:0:9954:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787432453.327298:0:9954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9954:1874258609357952:0@lo:900: 00000100:00100000:3.0:1787432453.327336:0:9954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432453.327387:0:9954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484359ecc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432453.329256:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609357952 00000100:00100000:0.0:1787432453.329268:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609357952 00000100:00100000:0.0:1787432453.329319:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432453.329329:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9954:x1874258609357952:12345-0@lo:900: 00000100:00100000:0.0:1787432453.329411:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9954:x1874258609357952:12345-0@lo:900: Request processed in 83us (2074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432453.329417:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787432453.331135:0:9954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483038c4000 x1874258609357952/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787432469 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432453.331154:0:9954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9954:1874258609357952:0@lo:900: 00000001:00080000:1.0:1787432453.333678:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1787432453.333700:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787432453.335551:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9958:x1874258609357696:12345-0@lo:5: Request processed in 30049us (44767us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787432453.335584:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787432453.335833:0:9958:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303798700 x1874258609357696/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787432469 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432453.335846:0:9958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787432453.335870:0:9958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9958:1874258609357696:0@lo:5: 00000004:00080000:1.0:1787432453.335885:0:9958:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787432453.335931:0:9958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9958:1874258609358080:0@lo:700: 00000100:00100000:1.0:1787432453.335967:0:9958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432453.336008:0:9958:0:(client.c:2715:ptlrpc_set_wait()) set ffff948406cb5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432453.336111:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609358080 00000100:00100000:3.0:1787432453.336117:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609358080 00000100:00100000:3.0:1787432453.336195:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432453.336205:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9958:x1874258609358080:12345-0@lo:700: 00000001:00080000:3.0:1787432453.343860:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1787432453.344071:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9958:x1874258609358080:12345-0@lo:700: Request processed in 7862us (8096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432453.344092:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787432453.344217:0:9958:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948301dbed80 x1874258609358080/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787432469 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432453.344233:0:9958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9958:1874258609358080:0@lo:700: 00000004:02000040:1.0:1787432453.346870:0:9958:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1787432453.359354:0:9958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9958:1874258609358208:0@lo:5: 00000100:00100000:2.0:1787432453.359428:0:9958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432453.359487:0:9958:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bbe780 going to sleep for 11 seconds 00000100:00100000:3.0:1787432453.363513:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609358208 00000100:00100000:3.0:1787432453.363527:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609358208 00000100:00100000:3.0:1787432453.363607:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787432453.363619:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9958:x1874258609358208:12345-0@lo:5: 00002000:00080000:3.0:1787432453.374352:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1787432453.374375:0:8430:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1787432453.382490:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9958:x1874258609358208:12345-0@lo:5: Request processed in 18866us (23053us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787432453.382503:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787432453.382983:0:9958:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830379a300 x1874258609358208/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787432469 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432453.383001:0:9958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9958:1874258609358208:0@lo:5: 00000004:00080000:0.0:1787432453.383025:0:9958:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:00080000:3.0:1787432453.794993:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:1.0:1787432454.347737:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432455.120437:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609358336:0@lo:41: 00000100:00100000:1.0:1787432455.120526:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432455.122266:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609358336 00000100:00100000:3.0:1787432455.122290:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609358336 00000100:00100000:3.0:1787432455.122376:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787432455.122390:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609358336:12345-0@lo:41: 00000004:00000024:3.0:1787432455.122440:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787432455.122561:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609358336:12345-0@lo:41: Request processed in 175us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432455.122570:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787432455.122642:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609358336:0@lo:41: 00010000:00010000:0.0:1787432455.372712:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787432456.076119:0:10035:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787432456.076619:0:10035:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787432456.396836:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787432457.186649:0:10083:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787432457.186660:0:10083:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1787432457.424322:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432457.666215:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432457.667860:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588336256 00000100:00100000:3.0:1787432457.667875:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588336256 00000100:00100000:3.0:1787432457.667947:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 181 00000100:00100000:3.0:1787432457.667956:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2399:x1874258588336256:12345-192.168.204.24@tcp:250: 00010000:00080000:3.0:1787432457.667989:0:6508:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a40dc378-0ae8-4eb1-a992-02a683490593@192.168.204.24@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:3.0:1787432457.668030:0:6508:0:(genops.c:1385:class_connect()) connect: client a40dc378-0ae8-4eb1-a992-02a683490593, cookie 0xca72b3b33563eb3b 00000100:00080000:3.0:1787432457.668209:0:6508:0:(import.c:65:import_set_state_nolock()) ffff9483036ec800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432457.668288:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+5:2399:x1874258588336256:12345-192.168.204.24@tcp:250: Request processed in 330us (2128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432457.668295:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 181 00000100:00100000:3.0:1787432457.691489:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432457.691592:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588336384 00000100:00100000:1.0:1787432457.691603:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588336384 00000100:00100000:1.0:1787432457.691661:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 182 00000100:00100000:1.0:1787432457.691673:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+5:6160:x1874258588336384:12345-192.168.204.24@tcp:101: 00010000:00010000:1.0:1787432457.691693:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432457.691713:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948401683200/0xca72b3b33563eb42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4bf5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432457.691742:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948401683200/0xca72b3b33563eb42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4bf5 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432457.691752:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948401683200/0xca72b3b33563eb42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4bf5 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432457.691777:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948401683200, rc 0) 00000100:00100000:1.0:1787432457.691841:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+6:6160:x1874258588336384:12345-192.168.204.24@tcp:101: Request processed in 169us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432457.691847:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 182 00000100:00100000:1.0:1787432457.697604:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432457.699799:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588336512 00000100:00100000:3.0:1787432457.699833:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588336512 00000100:00100000:2.0:1787432457.703865:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 183 00000100:00100000:2.0:1787432457.703892:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+6:6160:x1874258588336512:12345-192.168.204.24@tcp:501: 00000100:00100000:2.0:1787432457.704074:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+6:6160:x1874258588336512:12345-192.168.204.24@tcp:501: Request processed in 192us (6480us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787432457.704083:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 183 00000100:00100000:2.0:1787432457.706447:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432457.706528:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588336640 00000100:00100000:0.0:1787432457.706538:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588336640 00000100:00100000:0.0:1787432457.706597:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 184 00000100:00100000:0.0:1787432457.706608:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+6:6160:x1874258588336640:12345-192.168.204.24@tcp:101: 00010000:00010000:0.0:1787432457.706626:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432457.706644:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484013fd400/0xca72b3b33563eb49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4bfc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432457.706676:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fd400/0xca72b3b33563eb49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4bfc expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432457.706685:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484013fd400/0xca72b3b33563eb49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4bfc expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432457.706695:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fd400, rc 0) 00000100:00100000:0.0:1787432457.706764:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+7:6160:x1874258588336640:12345-192.168.204.24@tcp:101: Request processed in 158us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432457.706771:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 184 00000100:00100000:3.0:1787432457.708693:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432457.708801:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588336768 00000100:00100000:2.0:1787432457.708812:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588336768 00000100:00100000:2.0:1787432457.708886:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 185 00000100:00100000:2.0:1787432457.708899:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+7:6160:x1874258588336768:12345-192.168.204.24@tcp:501: 00000100:00100000:2.0:1787432457.709098:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+8:6160:x1874258588336768:12345-192.168.204.24@tcp:501: Request processed in 202us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432457.709106:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 185 00000100:00100000:2.0:1787432457.711771:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432457.712469:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588336896 00000100:00100000:1.0:1787432457.712482:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588336896 00000100:00100000:1.0:1787432457.712584:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 186 00000100:00100000:1.0:1787432457.712607:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405079c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+8:6160:x1874258588336896:12345-192.168.204.24@tcp:503: 00000100:00100000:1.0:1787432457.712790:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405079c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+8:6160:x1874258588336896:12345-192.168.204.24@tcp:503: Request processed in 186us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432457.712799:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 186 00000100:00100000:3.0:1787432457.715751:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432457.715885:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588337024 00000100:00100000:0.0:1787432457.715898:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588337024 00000100:00100000:0.0:1787432457.715973:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 187 00000100:00100000:0.0:1787432457.715987:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840507ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+8:6179:x1874258588337024:12345-192.168.204.24@tcp:502: 00000100:00100000:0.0:1787432457.716254:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840507ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+8:6179:x1874258588337024:12345-192.168.204.24@tcp:502: Request processed in 268us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432457.716269:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 187 00000100:00100000:3.0:1787432457.757789:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432457.757896:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588337152 00000100:00100000:0.0:1787432457.757909:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588337152 00000100:00100000:0.0:1787432457.757978:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 188 00000100:00100000:0.0:1787432457.757990:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+8:6179:x1874258588337152:12345-192.168.204.24@tcp:502: 00000100:00100000:0.0:1787432457.758212:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+8:6179:x1874258588337152:12345-192.168.204.24@tcp:502: Request processed in 223us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432457.758221:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 188 00000100:00100000:3.0:1787432457.765960:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432457.766145:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588337280 00000100:00100000:1.0:1787432457.766160:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588337280 00000100:00100000:1.0:1787432457.766277:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 189 00000100:00100000:1.0:1787432457.766290:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840507a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+8:6160:x1874258588337280:12345-192.168.204.24@tcp:101: 00010000:00010000:1.0:1787432457.766307:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432457.766330:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948401683600/0xca72b3b33563eb50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4c2d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432457.766380:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948401683600/0xca72b3b33563eb50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c2d expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432457.766393:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948401683600/0xca72b3b33563eb50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c2d expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432457.766424:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948401683600, rc 0) 00000100:00100000:1.0:1787432457.766498:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840507a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+9:6160:x1874258588337280:12345-192.168.204.24@tcp:101: Request processed in 210us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432457.766506:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 189 00000100:00100000:3.0:1787432457.769281:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432457.769420:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588337408 00000100:00100000:2.0:1787432457.769430:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588337408 00000100:00100000:2.0:1787432457.769499:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 190 00000100:00100000:2.0:1787432457.769512:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840507a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+9:6160:x1874258588337408:12345-192.168.204.24@tcp:256: 20000000:01000000:2.0:1787432457.769541:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787432457.769575:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787432457.769580:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787432457.769596:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787432457.769599:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787432457.769601:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1787432457.773152:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840507a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+9:6160:x1874258588337408:12345-192.168.204.24@tcp:256: Request processed in 3627us (3866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432457.773210:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 190 00000100:00100000:3.0:1787432457.779828:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432457.779989:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588337536 00000100:00100000:0.0:1787432457.780004:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588337536 00000100:00100000:0.0:1787432457.780097:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 191 00000100:00100000:0.0:1787432457.780106:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+9:6160:x1874258588337536:12345-192.168.204.24@tcp:101: 00010000:00010000:0.0:1787432457.780124:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432457.780151:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484013fdc00/0xca72b3b33563eb57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4c34 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432457.780238:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fdc00/0xca72b3b33563eb57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c34 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432457.780249:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484013fdc00/0xca72b3b33563eb57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c34 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432457.780259:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fdc00, rc 0) 00000100:00100000:0.0:1787432457.780315:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+10:6160:x1874258588337536:12345-192.168.204.24@tcp:101: Request processed in 210us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432457.780322:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 191 00000100:00100000:3.0:1787432457.782837:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432457.782978:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588337664 00000100:00100000:2.0:1787432457.783013:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588337664 00000100:00100000:2.0:1787432457.783102:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 192 00000100:00100000:2.0:1787432457.783113:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:6160:x1874258588337664:12345-192.168.204.24@tcp:501: 00000100:00100000:2.0:1787432457.783599:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:6160:x1874258588337664:12345-192.168.204.24@tcp:501: Request processed in 485us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432457.783607:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 192 00000100:00100000:3.0:1787432457.786497:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432457.786578:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588337792 00000100:00100000:2.0:1787432457.786590:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588337792 00000100:00100000:2.0:1787432457.786649:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 193 00000100:00100000:2.0:1787432457.786659:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+10:6160:x1874258588337792:12345-192.168.204.24@tcp:503: 00000100:00100000:2.0:1787432457.786959:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+10:6160:x1874258588337792:12345-192.168.204.24@tcp:503: Request processed in 300us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432457.786968:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 193 00000100:00100000:3.0:1787432457.789759:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432457.789982:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588337920 00000100:00100000:2.0:1787432457.789995:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588337920 00000100:00100000:2.0:1787432457.790072:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 194 00000100:00100000:2.0:1787432457.790083:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:6184:x1874258588337920:12345-192.168.204.24@tcp:502: 00000100:00100000:2.0:1787432457.790298:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:6184:x1874258588337920:12345-192.168.204.24@tcp:502: Request processed in 215us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432457.790307:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 194 00000100:00100000:1.0:1787432457.799663:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432457.799804:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588338048 00000100:00100000:2.0:1787432457.799821:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588338048 00000100:00100000:2.0:1787432457.799911:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 195 00000100:00100000:2.0:1787432457.799925:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+10:6184:x1874258588338048:12345-192.168.204.24@tcp:502: 00000100:00100000:2.0:1787432457.801117:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+10:6184:x1874258588338048:12345-192.168.204.24@tcp:502: Request processed in 241us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432457.801151:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 195 00000100:00100000:3.0:1787432457.806364:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432457.806477:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432457.811937:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588338176 00000100:00100000:1.0:1787432457.811952:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588338176 00000100:00100000:1.0:1787432457.812010:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588338432 00000100:00100000:1.0:1787432457.812013:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588338432 00000100:00100000:1.0:1787432457.812057:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:1.0:1787432457.812065:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1874258588338176:12345-192.168.204.24@tcp:38: 00010000:00080000:1.0:1787432457.812094:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:1.0:1787432457.812145:0:6514:0:(genops.c:1385:class_connect()) connect: client e37f63ac-9665-4d30-ad26-0faad6e6c7da, cookie 0xca72b3b33563eb5e 00000004:00100000:1.0:1787432457.812184:0:6514:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787432457.812426:0:6514:0:(import.c:65:import_set_state_nolock()) ffff948303552000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432457.812512:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2399:x1874258588338176:12345-192.168.204.24@tcp:38: Request processed in 444us (6178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432457.812521:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:1.0:1787432457.812541:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:1.0:1787432457.812546:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1874258588338432:12345-192.168.204.24@tcp:38: 00010000:00080000:1.0:1787432457.812563:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:1.0:1787432457.812596:0:6514:0:(genops.c:1385:class_connect()) connect: client e37f63ac-9665-4d30-ad26-0faad6e6c7da, cookie 0xca72b3b33563eb65 00000004:00100000:1.0:1787432457.812609:0:6514:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787432457.812761:0:6514:0:(import.c:65:import_set_state_nolock()) ffff948303556800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432457.812805:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2399:x1874258588338432:12345-192.168.204.24@tcp:38: Request processed in 257us (6328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432457.812812:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:2.0:1787432458.187385:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787432458.187418:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609358464:0@lo:13: 00000100:00100000:2.0:1787432458.187498:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432458.187589:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609358592:0@lo:13: 00000100:00100000:2.0:1787432458.187616:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432458.187665:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609358464 00000100:00100000:1.0:1787432458.187674:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609358464 00000100:00100000:1.0:1787432458.187746:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609358592 00000100:00100000:1.0:1787432458.187749:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609358592 00000100:00100000:1.0:1787432458.187785:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787432458.187795:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609358464:12345-0@lo:13: 00002000:00000024:1.0:1787432458.187824:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432458.187876:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609358464:12345-0@lo:13: Request processed in 82us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432458.187884:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1787432458.187892:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432458.187901:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787432458.187908:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609358592:12345-0@lo:13: 00002000:00000024:1.0:1787432458.187918:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432458.187942:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609358592:12345-0@lo:13: Request processed in 35us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432458.187948:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787432458.188045:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483038c6300 x1874258609358464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432458.188064:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609358464:0@lo:13: 00010000:00080000:3.0:1787432458.188077:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830379aa00 x1874258609358592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432458.188111:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609358592:0@lo:13: 00000100:00100000:1.0:1787432458.188382:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432458.188394:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609358720:0@lo:41: 00000100:00100000:1.0:1787432458.188434:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432458.188722:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609358720 00000100:00100000:0.0:1787432458.188738:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609358720 00000100:00100000:0.0:1787432458.188789:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787432458.188798:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609358720:12345-0@lo:41: 00000004:00000024:0.0:1787432458.188824:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787432458.188876:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609358720:12345-0@lo:41: Request processed in 80us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432458.188892:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787432458.189063:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609358720:0@lo:41: 00010000:00010000:0.0:1787432458.443602:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432458.699454:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609358976:0@lo:400: 00000100:00100000:2.0:1787432458.699459:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609359232:0@lo:400: 00000100:00100000:1.0:1787432458.699530:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609358848:0@lo:400: 00000100:00100000:0.0:1787432458.699551:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609359104:0@lo:400: 00000100:00100000:2.0:1787432458.704366:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432458.704456:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609359744:0@lo:400: 00000100:00100000:2.0:1787432458.704496:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432458.704601:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432458.704633:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609359488:0@lo:400: 00000100:00100000:3.0:1787432458.704658:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432458.704682:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609360000:0@lo:400: 00000100:00100000:3.0:1787432458.704710:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432458.704776:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609359744 00000100:00100000:3.0:1787432458.704785:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609359744 00000100:00100000:3.0:1787432458.704834:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609358976 00000100:00100000:3.0:1787432458.704838:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609358976 00000100:00100000:3.0:1787432458.704853:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609359488 00000100:00100000:3.0:1787432458.704855:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609359488 00000100:00100000:3.0:1787432458.704872:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787432458.704881:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609359744:12345-0@lo:400: 00000100:00100000:3.0:1787432458.704929:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609359744:12345-0@lo:400: Request processed in 49us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432458.704954:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787432458.704971:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787432458.704977:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609358976:12345-0@lo:400: 00000100:00100000:3.0:1787432458.705011:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609358976:12345-0@lo:400: Request processed in 34us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432458.705016:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787432458.705028:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787432458.705034:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609359488:12345-0@lo:400: 00000100:00100000:3.0:1787432458.705079:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609359488:12345-0@lo:400: Request processed in 45us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432458.705086:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787432458.705107:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609360000 00000100:00100000:3.0:1787432458.705110:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609360000 00000100:00100000:3.0:1787432458.705137:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787432458.705144:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609360000:12345-0@lo:400: 00000100:00100000:3.0:1787432458.705204:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609360000:12345-0@lo:400: Request processed in 61us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432458.705210:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787432458.705230:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432458.705234:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787432458.705285:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303799c00 x1874258609358976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432458.705300:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609358976:0@lo:400: 00010000:00080000:3.0:1787432458.705311:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830379bb80 x1874258609359488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432458.705319:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609359488:0@lo:400: 00010000:00080000:3.0:1787432458.705340:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303798700 x1874258609360000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432458.705347:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1787432458.705361:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609360000:0@lo:400: 00000100:00100000:3.0:1787432458.705410:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609359232 00000100:00100000:3.0:1787432458.705414:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609359232 00000100:00100000:3.0:1787432458.705439:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787432458.705445:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609359232:12345-0@lo:400: 00000100:00100000:3.0:1787432458.705483:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609359232:12345-0@lo:400: Request processed in 38us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432458.705489:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1787432458.706905:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830379b100 x1874258609359744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432458.706924:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609359744:0@lo:400: 00000100:00100000:2.0:1787432458.706961:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609360256:0@lo:13: 00000100:00100000:2.0:1787432458.707041:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432458.707074:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609359232:0@lo:400: 00000100:00100000:3.0:1787432458.708202:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609360256 00000100:00100000:3.0:1787432458.708218:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609360256 00000100:00100000:3.0:1787432458.708300:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787432458.708311:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609360256:12345-0@lo:13: 00002000:00000024:3.0:1787432458.708354:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432458.708418:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609360256:12345-0@lo:13: Request processed in 110us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432458.708425:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787432458.708865:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948302765880 x1874258609360256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432458.708884:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609360256:0@lo:13: 00000100:00100000:1.0:1787432458.709113:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432458.709178:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609359360:0@lo:400: 00000100:00100000:1.0:1787432458.709231:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432458.709266:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609359872:0@lo:400: 00000100:00100000:1.0:1787432458.709291:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432458.710147:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609359872 00000100:00100000:2.0:1787432458.710198:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609359872 00000100:00100000:2.0:1787432458.710271:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787432458.710282:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435bab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609359872:12345-0@lo:400: 00000100:00100000:2.0:1787432458.710372:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435bab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609359872:12345-0@lo:400: Request processed in 92us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432458.710378:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787432458.710407:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609359360 00000100:00100000:2.0:1787432458.710412:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609359360 00000100:00100000:2.0:1787432458.710441:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787432458.710448:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609359360:12345-0@lo:400: 00000100:00100000:2.0:1787432458.710485:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609359360:12345-0@lo:400: Request processed in 38us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432458.710491:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787432458.710590:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609358848 00000100:00100000:3.0:1787432458.710595:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609358848 00000100:00100000:3.0:1787432458.710631:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787432458.710638:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3641:x1874258609358848:12345-0@lo:400: 00000100:00100000:3.0:1787432458.710677:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3641:x1874258609358848:12345-0@lo:400: Request processed in 40us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432458.710683:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:1.0:1787432458.711207:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432458.711215:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432458.711257:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609358848:0@lo:400: 00010000:00080000:1.0:1787432458.711278:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303798380 x1874258609359360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432458.711291:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609359360:0@lo:400: 00010000:00080000:1.0:1787432458.711303:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830379aa00 x1874258609359872/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432458.711311:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787432458.711337:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609359872:0@lo:400: 00000100:00100000:1.0:1787432458.715639:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432458.715848:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609359616:0@lo:400: 00000100:00100000:1.0:1787432458.715886:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432458.715925:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609360128:0@lo:13: 00000100:00100000:1.0:1787432458.715953:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432458.716739:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609359104 00000100:00100000:3.0:1787432458.716751:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609359104 00000100:00100000:3.0:1787432458.716815:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609359616 00000100:00100000:3.0:1787432458.716819:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609359616 00000100:00100000:3.0:1787432458.716859:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787432458.716870:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609359104:12345-0@lo:400: 00000100:00100000:3.0:1787432458.716963:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609359104:12345-0@lo:400: Request processed in 95us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432458.716970:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787432458.717003:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787432458.717011:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609359616:12345-0@lo:400: 00000100:00100000:3.0:1787432458.717042:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609359616:12345-0@lo:400: Request processed in 32us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432458.717048:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787432458.717404:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787432458.717441:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830379b800 x1874258609359104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432458.717455:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609359104:0@lo:400: 00010000:00080000:1.0:1787432458.717465:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303798e00 x1874258609359616/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432458.717485:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609359616:0@lo:400: 00000100:00100000:0.0:1787432458.717657:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609360128 00000100:00100000:0.0:1787432458.717726:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609360128 00000100:00100000:0.0:1787432458.717836:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787432458.717845:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609360128:12345-0@lo:13: 00002000:00000024:0.0:1787432458.717864:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432458.717924:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609360128:12345-0@lo:13: Request processed in 80us (1969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432458.717930:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787432458.719012:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483038c6300 x1874258609360128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432458.719036:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609360128:0@lo:13: 00000100:00100000:3.0:1787432458.818349:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432458.818408:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432458.818527:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588338304 00000100:00100000:2.0:1787432458.818540:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588338304 00000100:00100000:2.0:1787432458.818643:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588338688 00000100:00100000:2.0:1787432458.818651:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588338688 00000100:00100000:2.0:1787432458.818671:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:2.0:1787432458.818682:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:0:x1874258588338304:12345-192.168.204.24@tcp:41: 00000004:00000024:2.0:1787432458.818717:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787432458.818782:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:0:x1874258588338304:12345-192.168.204.24@tcp:41: Request processed in 101us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432458.818789:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:2.0:1787432458.818806:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 10 00000100:00100000:2.0:1787432458.818813:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:6160:x1874258588338688:12345-192.168.204.24@tcp:41: 00000004:00000024:2.0:1787432458.818824:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787432458.818844:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:6160:x1874258588338688:12345-192.168.204.24@tcp:41: Request processed in 31us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432458.818850:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 10 00000100:00080000:3.0:1787432458.819223:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432458.819963:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432458.820047:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588338560 00000100:00100000:2.0:1787432458.820054:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588338560 00000100:00100000:2.0:1787432458.820118:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 11 00000100:00100000:2.0:1787432458.820126:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:0:x1874258588338560:12345-192.168.204.24@tcp:41: 00000004:00000024:2.0:1787432458.820158:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787432458.820267:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:0:x1874258588338560:12345-192.168.204.24@tcp:41: Request processed in 141us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432458.820275:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 11 00000100:00080000:3.0:1787432458.820907:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787432458.821814:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432458.821949:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588338816 00000100:00100000:0.0:1787432458.821958:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588338816 00000100:00100000:0.0:1787432458.822037:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:0.0:1787432458.822049:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:6160:x1874258588338816:12345-192.168.204.24@tcp:40: 00000100:00100000:0.0:1787432458.822154:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:6160:x1874258588338816:12345-192.168.204.24@tcp:40: Request processed in 107us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432458.822203:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:1.0:1787432458.826498:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432458.826556:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432458.826595:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432458.826633:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432458.826670:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588338944 00000100:00100000:1.0:1787432458.826682:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588338944 00000100:00100000:1.0:1787432458.826715:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588339072 00000100:00100000:1.0:1787432458.826719:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588339072 00000100:00100000:1.0:1787432458.826739:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:1.0:1787432458.826747:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1874258588338944:12345-192.168.204.24@tcp:8: 00010000:00080000:1.0:1787432458.826783:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:1.0:1787432458.826848:0:8432:0:(genops.c:1385:class_connect()) connect: client e37f63ac-9665-4d30-ad26-0faad6e6c7da, cookie 0xca72b3b33563eb6c 00002000:00100000:1.0:1787432458.826862:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e37f63ac-9665-4d30-ad26-0faad6e6c7da/ffff948303554800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787432458.826874:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787432458.827088:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787432458.827124:0:8432:0:(import.c:65:import_set_state_nolock()) ffff948303553800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432458.827248:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2399:x1874258588338944:12345-192.168.204.24@tcp:8: Request processed in 500us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432458.827257:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:1.0:1787432458.827279:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:1.0:1787432458.827285:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1874258588339072:12345-192.168.204.24@tcp:8: 00010000:00080000:1.0:1787432458.827303:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:1.0:1787432458.827337:0:8432:0:(genops.c:1385:class_connect()) connect: client e37f63ac-9665-4d30-ad26-0faad6e6c7da, cookie 0xca72b3b33563eb73 00002000:00100000:1.0:1787432458.827343:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e37f63ac-9665-4d30-ad26-0faad6e6c7da/ffff948303553000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787432458.827351:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787432458.827487:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787432458.827503:0:8432:0:(import.c:65:import_set_state_nolock()) ffff948303551000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432458.827527:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2399:x1874258588339072:12345-192.168.204.24@tcp:8: Request processed in 241us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432458.827533:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:3.0:1787432458.828394:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588339328 00000100:00100000:3.0:1787432458.828407:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588339328 00000100:00100000:3.0:1787432458.828460:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 197 00000100:00100000:3.0:1787432458.828469:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:2403:x1874258588339328:12345-192.168.204.24@tcp:400: 00000100:00100000:3.0:1787432458.828523:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:2403:x1874258588339328:12345-192.168.204.24@tcp:400: Request processed in 55us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432458.828530:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 197 00000100:00100000:0.0:1787432458.828840:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588339200 00000100:00100000:0.0:1787432458.828846:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588339200 00000100:00100000:0.0:1787432458.828892:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 4 00000100:00100000:0.0:1787432458.828912:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:6160:x1874258588339200:12345-192.168.204.24@tcp:900: 00000100:00100000:0.0:1787432458.828951:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:6160:x1874258588339200:12345-192.168.204.24@tcp:900: Request processed in 41us (2467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432458.828958:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 4 00000100:00100000:1.0:1787432458.836842:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432458.837743:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588339456 00000100:00100000:3.0:1787432458.837758:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588339456 00000100:00100000:3.0:1787432458.837879:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:3.0:1787432458.837890:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:6160:x1874258588339456:12345-192.168.204.24@tcp:33: 00000004:00080000:3.0:1787432458.861350:0:6516:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 23367us 00000004:00200000:0.0:1787432458.875711:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787432458.875840:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:6160:x1874258588339456:12345-192.168.204.24@tcp:33: Request processed in 37943us (39005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432458.875859:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:1.0:1787432459.078360:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432459.079336:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588339584 00000100:00100000:2.0:1787432459.079350:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588339584 00000100:00100000:2.0:1787432459.079425:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 13 00000100:00100000:2.0:1787432459.079438:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:6202:x1874258588339584:12345-192.168.204.24@tcp:101: 00010000:00010000:2.0:1787432459.079460:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432459.079490:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e4600/0xca72b3b33563eb7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4c65 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432459.079590:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563eb81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432459.079604:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563eb81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432459.079619:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563eb81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432459.079666:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787432459.079670:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787432459.079684:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563eb81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432459.079716:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e4600/0xca72b3b33563eb7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c65 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432459.079734:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563eb81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c65 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432459.079754:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948405994f00) 00010000:00010000:2.0:1787432459.079757:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432459.079761:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e600, rc 0) 00000100:00100000:2.0:1787432459.079822:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:6202:x1874258588339584:12345-192.168.204.24@tcp:101: Request processed in 387us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432459.079830:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 13 00010000:00010000:0.0:1787432459.467505:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432460.235941:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609360384:0@lo:41: 00000100:00100000:1.0:1787432460.236110:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432460.236678:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609360384 00000100:00100000:3.0:1787432460.236688:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609360384 00000100:00100000:3.0:1787432460.236742:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787432460.236750:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609360384:12345-0@lo:41: 00000004:00000024:3.0:1787432460.236784:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787432460.236832:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609360384:12345-0@lo:41: Request processed in 82us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432460.236840:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787432460.236891:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609360384:0@lo:41: 00010000:00010000:0.0:1787432460.494550:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432461.262319:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432461.262400:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588339712 00000100:00100000:2.0:1787432461.262414:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588339712 00000100:00100000:2.0:1787432461.262500:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00100000:2.0:1787432461.262515:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:6255:x1874258588339712:12345-192.168.204.24@tcp:41: 00000100:00080000:3.0:1787432461.262557:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1787432461.262557:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787432461.262631:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:6255:x1874258588339712:12345-192.168.204.24@tcp:41: Request processed in 122us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432461.262639:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00100000:1.0:1787432461.266215:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432461.269341:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588339840 00000100:00100000:0.0:1787432461.269359:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588339840 00000100:00100000:0.0:1787432461.269505:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00100000:0.0:1787432461.269532:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:6255:x1874258588339840:12345-192.168.204.24@tcp:41: 00000004:00000024:0.0:1787432461.269573:0:9020:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432461.269649:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:6255:x1874258588339840:12345-192.168.204.24@tcp:41: Request processed in 134us (3492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432461.269657:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00080000:3.0:1787432461.272374:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787432461.272924:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432461.273296:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588339968 00000100:00100000:0.0:1787432461.273307:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588339968 00000100:00100000:0.0:1787432461.273429:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00100000:0.0:1787432461.273441:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:6255:x1874258588339968:12345-192.168.204.24@tcp:13: 00002000:00000024:0.0:1787432461.273474:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787432461.273519:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432461.273556:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:6255:x1874258588339968:12345-192.168.204.24@tcp:13: Request processed in 116us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432461.273564:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00100000:3.0:1787432461.276721:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432461.279398:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588340096 00000100:00100000:1.0:1787432461.279414:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588340096 00000100:00100000:1.0:1787432461.280095:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 19 00000100:00100000:1.0:1787432461.280116:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:6255:x1874258588340096:12345-192.168.204.24@tcp:13: 00002000:00000024:1.0:1787432461.280192:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432461.280298:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:6255:x1874258588340096:12345-192.168.204.24@tcp:13: Request processed in 189us (3593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432461.280306:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 19 00000100:00080000:3.0:1787432461.282380:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787432461.515426:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432462.541140:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787432462.796813:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000100:00100000:3.0:1787432463.307572:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432463.307598:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609360512:0@lo:13: 00000100:00100000:3.0:1787432463.307675:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432463.307746:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609360512 00000100:00100000:3.0:1787432463.307752:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609360512 00000100:00100000:3.0:1787432463.307805:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787432463.307814:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609360512:12345-0@lo:13: 00002000:00000024:3.0:1787432463.307838:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432463.307876:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609360512:12345-0@lo:13: Request processed in 63us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432463.307883:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1787432463.307902:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787432463.307929:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830379aa00 x1874258609360512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432463.307964:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609360512:0@lo:13: 00000100:00100000:1.0:1787432463.308353:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432463.308363:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609360640:0@lo:41: 00000100:00100000:1.0:1787432463.308404:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432463.308832:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609360640 00000100:00100000:0.0:1787432463.308839:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609360640 00000100:00100000:0.0:1787432463.308883:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787432463.308892:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609360640:12345-0@lo:41: 00000004:00000024:0.0:1787432463.308920:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787432463.308965:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609360640:12345-0@lo:41: Request processed in 74us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432463.308971:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787432463.309004:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609360640:0@lo:41: 00000100:00100000:3.0:1787432463.309439:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432463.309453:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609360768:0@lo:13: 00000100:00100000:3.0:1787432463.309616:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432463.309701:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609360768 00000100:00100000:1.0:1787432463.309706:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609360768 00000100:00100000:1.0:1787432463.309766:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787432463.309774:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609360768:12345-0@lo:13: 00002000:00000024:1.0:1787432463.309788:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432463.309825:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609360768:12345-0@lo:13: Request processed in 52us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432463.309831:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787432463.309858:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435b65500 x1874258609360768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432463.309872:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609360768:0@lo:13: 00000100:00080000:3.0:1787432463.309963:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787432463.566947:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432463.820766:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609360896:0@lo:13: 00000100:00100000:3.0:1787432463.820869:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432463.820979:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609360896 00000100:00100000:1.0:1787432463.820992:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609360896 00000100:00100000:3.0:1787432463.821012:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432463.821022:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609361024:0@lo:13: 00000100:00100000:3.0:1787432463.821051:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432463.821064:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609361024 00000100:00100000:1.0:1787432463.821068:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609361024 00000100:00100000:1.0:1787432463.821096:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787432463.821120:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609360896:12345-0@lo:13: 00002000:00000024:1.0:1787432463.821188:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787432463.821200:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432463.821213:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432463.821235:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609361536:0@lo:400: 00000100:00100000:1.0:1787432463.821248:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609360896:12345-0@lo:13: Request processed in 140us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432463.821257:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787432463.821281:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609361920:0@lo:400: 00000100:00100000:1.0:1787432463.821283:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787432463.821287:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432463.821297:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609361024:12345-0@lo:13: 00002000:00000024:1.0:1787432463.821309:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432463.821320:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609361408:0@lo:400: 00000100:00100000:3.0:1787432463.821334:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432463.821349:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609361024:12345-0@lo:13: Request processed in 54us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432463.821357:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787432463.821363:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787432463.821383:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303799880 x1874258609361024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432463.821385:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609361152:0@lo:400: 00000100:00100000:2.0:1787432463.821409:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609362048:0@lo:400: 00000100:00100000:3.0:1787432463.821411:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609361024:0@lo:13: 00010000:00080000:3.0:1787432463.821430:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830379ad80 x1874258609360896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432463.821442:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609360896:0@lo:13: 00000100:00100000:3.0:1787432463.821478:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609361920 00000100:00100000:3.0:1787432463.821482:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609361920 00000100:00100000:3.0:1787432463.821522:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609361408 00000100:00100000:3.0:1787432463.821526:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609361408 00000100:00100000:3.0:1787432463.821548:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787432463.821555:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609361920:12345-0@lo:400: 00000100:00100000:2.0:1787432463.821602:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432463.821633:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609361536 00000100:00100000:2.0:1787432463.821637:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609361536 00000100:00100000:2.0:1787432463.821673:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787432463.821681:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609361536:12345-0@lo:400: 00000100:00100000:2.0:1787432463.821726:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609361536:12345-0@lo:400: Request processed in 46us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432463.821733:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787432463.821766:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609361536:0@lo:400: 00000100:00100000:0.0:1787432463.821928:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609361280:0@lo:400: 00000100:00100000:0.0:1787432463.821969:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432463.821986:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609361792:0@lo:400: 00000100:00100000:0.0:1787432463.822009:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432463.822037:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609362048 00000100:00100000:0.0:1787432463.822041:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609362048 00000100:00100000:0.0:1787432463.822061:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609361280 00000100:00100000:0.0:1787432463.822064:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609361280 00000100:00100000:0.0:1787432463.822076:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609361792 00000100:00100000:0.0:1787432463.822078:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609361792 00000100:00100000:0.0:1787432463.822092:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787432463.822099:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609361408:12345-0@lo:400: 00000100:00100000:1.0:1787432463.822239:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432463.822267:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609361152 00000100:00100000:2.0:1787432463.822272:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609361152 00000100:00100000:2.0:1787432463.822301:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787432463.822307:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609361152:12345-0@lo:400: 00000100:00100000:1.0:1787432463.822384:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609361664:0@lo:400: 00000100:00100000:1.0:1787432463.822411:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432463.822436:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787432463.822444:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787432463.822470:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787432463.822475:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609361664 00000100:00100000:1.0:1787432463.822478:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609361664 00000100:00100000:1.0:1787432463.822497:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787432463.822503:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787432463.822510:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609362048:12345-0@lo:400: 00000100:00100000:1.0:1787432463.822549:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609362048:12345-0@lo:400: Request processed in 39us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432463.822555:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787432463.822569:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787432463.822574:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787432463.822582:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609361280:12345-0@lo:400: 00000100:00100000:1.0:1787432463.822615:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609361280:12345-0@lo:400: Request processed in 34us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432463.822620:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787432463.822630:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787432463.822635:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787432463.822641:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609361792:12345-0@lo:400: 00000100:00100000:1.0:1787432463.822666:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609361792:12345-0@lo:400: Request processed in 25us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432463.822671:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787432463.822680:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787432463.822685:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787432463.822700:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609361664:12345-0@lo:400: 00000100:00100000:1.0:1787432463.822746:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609361664:12345-0@lo:400: Request processed in 47us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432463.822752:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787432463.822899:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609361280:0@lo:400: 00010000:00080000:1.0:1787432463.822915:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f85ad80 x1874258609361792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432463.822925:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609361792:0@lo:400: 00000100:00100000:1.0:1787432463.822959:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609361664:0@lo:400: 00010000:00080000:1.0:1787432463.822985:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f85b480 x1874258609362048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432463.822995:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609362048:0@lo:400: 00000100:00080000:1.0:1787432463.823296:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432463.823303:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432463.823802:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609361152:12345-0@lo:400: Request processed in 1491us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432463.823813:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787432463.823882:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609361152:0@lo:400: 00000001:00100000:2.0:1787432463.825351:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000100:00100000:0.0:1787432463.825967:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609361408:12345-0@lo:400: Request processed in 3857us (4597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432463.825984:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787432463.826148:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609361408:0@lo:400: 00000100:00100000:3.0:1787432463.826937:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609361920:12345-0@lo:400: Request processed in 5377us (5599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432463.826956:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787432463.827089:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609361920:0@lo:400: 00000001:00100000:2.0:1787432463.828814:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000100:00100000:3.0:1787432463.894796:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432463.894844:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432463.894931:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588340224 00000100:00100000:2.0:1787432463.894943:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588340224 00000100:00100000:2.0:1787432463.895012:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 199 00000100:00100000:2.0:1787432463.895023:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+10:2401:x1874258588340224:12345-192.168.204.24@tcp:400: 00000100:00100000:2.0:1787432463.895147:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+10:2401:x1874258588340224:12345-192.168.204.24@tcp:400: Request processed in 125us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432463.895156:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 199 00000100:00100000:1.0:1787432463.895215:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588340480 00000100:00100000:1.0:1787432463.895220:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588340480 00000100:00100000:1.0:1787432463.895294:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 61 00000100:00100000:1.0:1787432463.895302:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588340480:12345-192.168.204.24@tcp:400: 00000100:00100000:1.0:1787432463.895337:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588340480:12345-192.168.204.24@tcp:400: Request processed in 36us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432463.895344:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 61 00000100:00080000:2.0:1787432463.895473:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432463.901501:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432463.901543:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432463.901571:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432463.901598:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588340736 00000100:00100000:1.0:1787432463.901614:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588340736 00000100:00100000:1.0:1787432463.901670:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588340608 00000100:00100000:1.0:1787432463.901674:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588340608 00000100:00100000:1.0:1787432463.901707:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:1.0:1787432463.901718:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588340736:12345-192.168.204.24@tcp:400: 00000100:00100000:1.0:1787432463.901800:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588340736:12345-192.168.204.24@tcp:400: Request processed in 83us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432463.901808:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:1.0:1787432463.901826:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:1.0:1787432463.901833:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2401:x1874258588340608:12345-192.168.204.24@tcp:400: 00000100:00100000:1.0:1787432463.901858:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2401:x1874258588340608:12345-192.168.204.24@tcp:400: Request processed in 26us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432463.901864:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:1.0:1787432463.901881:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588340352 00000100:00100000:1.0:1787432463.901885:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588340352 00000100:00100000:1.0:1787432463.901927:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 62 00000100:00100000:1.0:1787432463.901934:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2401:x1874258588340352:12345-192.168.204.24@tcp:400: 00000100:00100000:1.0:1787432463.901961:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2401:x1874258588340352:12345-192.168.204.24@tcp:400: Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432463.901967:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 62 00000100:00080000:2.0:1787432463.904428:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787432463.904441:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787432463.904444:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1787432464.404589:0:10195:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787432464.599616:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787432464.851337:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000100:00100000:1.0:1787432465.357104:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609362176:0@lo:41: 00000100:00100000:1.0:1787432465.357223:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432465.357419:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609362176 00000100:00100000:0.0:1787432465.357428:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609362176 00000100:00100000:0.0:1787432465.357502:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787432465.357513:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609362176:12345-0@lo:41: 00000004:00000024:0.0:1787432465.357545:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432465.357594:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609362176:12345-0@lo:41: Request processed in 82us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432465.357602:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787432465.357759:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609362176:0@lo:41: 00010000:00010000:0.0:1787432465.612699:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432466.646742:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432467.659490:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432468.427289:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609362432:0@lo:13: 00000100:00100000:1.0:1787432468.427364:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432468.427444:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609362304:0@lo:13: 00000100:00100000:1.0:1787432468.427469:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432468.427515:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609362432 00000100:00100000:1.0:1787432468.427524:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609362432 00000100:00100000:1.0:1787432468.427581:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609362304 00000100:00100000:1.0:1787432468.427584:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609362304 00000100:00100000:1.0:1787432468.427601:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787432468.427612:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609362432:12345-0@lo:13: 00002000:00000024:1.0:1787432468.427650:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432468.427699:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609362432:12345-0@lo:13: Request processed in 88us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432468.427706:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787432468.427723:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787432468.427729:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609362304:12345-0@lo:13: 00002000:00000024:1.0:1787432468.427739:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432468.427763:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609362304:12345-0@lo:13: Request processed in 34us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432468.427769:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787432468.427785:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787432468.427816:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f859c00 x1874258609362432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432468.428020:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609362432:0@lo:13: 00010000:00080000:1.0:1787432468.428038:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f8cc700 x1874258609362304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432468.428050:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609362304:0@lo:13: 00000100:00100000:1.0:1787432468.428509:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609362560:0@lo:41: 00000100:00100000:1.0:1787432468.428552:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432468.428596:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609362560 00000100:00100000:1.0:1787432468.428601:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609362560 00000100:00100000:1.0:1787432468.428634:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787432468.428641:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609362560:12345-0@lo:41: 00000004:00000024:1.0:1787432468.428670:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787432468.428709:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609362560:12345-0@lo:41: Request processed in 69us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432468.428716:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787432468.428749:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609362560:0@lo:41: 00000020:00000080:3.0:1787432468.620430:0:10343:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff16e8dff0 20000000:00000080:3.0:1787432468.620457:0:10343:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff948303900000 uarg=0000000000000000 20000000:01000000:3.0:1787432468.620533:0:10343:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787432468.620535:0:10343:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787432468.620540:0:10343:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787432468.620547:0:10343:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787432468.620553:0:10343:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787432468.620734:0:10343:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787432468.620738:0:10343:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787432468.624462:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1787432468.624971:0:10343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1787432468.625003:0:10343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1787432468.625100:0:10343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1787432468.625116:0:10343:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787432468.625119:0:10343:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787432468.627145:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1787432468.627602:0:10343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1787432468.627647:0:10343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1787432468.627663:0:10343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1787432468.627676:0:10343:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787432468.627678:0:10343:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787432468.628058:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1787432468.628327:0:10343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1787432468.628349:0:10343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1787432468.628365:0:10343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1787432468.628386:0:10343:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787432468.628388:0:10343:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787432468.628879:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1787432468.629402:0:10343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1787432468.629431:0:10343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1787432468.629446:0:10343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1787432468.629455:0:10343:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787432468.629457:0:10343:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787432468.630076:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1787432468.630386:0:10343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1787432468.630414:0:10343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1787432468.630429:0:10343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:2.0:1787432468.630443:0:10343:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787432468.630469:0:10343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94843f85e200/0xca72b3b33563eb88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.630492:0:10343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948303012e00/0xca72b3b33563ea23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ea1c expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.630512:0:10343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948303013400/0xca72b3b33563ea4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ea46 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.630519:0:10343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484032e5c00/0xca72b3b33563ea8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ea85 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.630527:0:10343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948400030000/0xca72b3b33563ea9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ea93 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.630536:0:10343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948401682200/0xca72b3b33563eaa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563eaa1 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.630543:0:10343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484032e4a00/0xca72b3b33563eac4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563eabd expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.630551:0:10343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948400031600/0xca72b3b33563eaee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563eae7 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.630557:0:10343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484032e5600/0xca72b3b33563eb0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563eb03 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.630564:0:10343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948303013800/0xca72b3b33563eb34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563eb26 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.630574:0:10343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948401683200/0xca72b3b33563eb42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4bf5 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.630582:0:10343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484013fd400/0xca72b3b33563eb49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4bfc expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.630599:0:10343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94843f85e200/0xca72b3b33563eb88 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.630662:0:10343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484013fd400/0xca72b3b33563eb49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4bfc expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.630684:0:10343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9484013fd400/0xca72b3b33563eb49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4bfc expref: 9 pid: 6507 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432468.630702:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b67480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609362688:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432468.630844:0:10343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948401683200/0xca72b3b33563eb42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4bf5 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.630853:0:10343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948401683200/0xca72b3b33563eb42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4bf5 expref: 9 pid: 6506 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432468.630861:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609362816:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432468.630916:0:10343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948303013800/0xca72b3b33563eb34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563eb26 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.630925:0:10343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948303013800/0xca72b3b33563eb34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563eb26 expref: 23 pid: 6508 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432468.630934:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b66d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609362944:0@lo:104: 00000100:00100000:2.0:1787432468.630989:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432468.631056:0:10343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484032e5600/0xca72b3b33563eb0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563eb03 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.631076:0:10343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9484032e5600/0xca72b3b33563eb0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563eb03 expref: 23 pid: 6508 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432468.631084:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b67800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609363072:0@lo:104: 00000100:00100000:2.0:1787432468.631107:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432468.631128:0:10343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948400031600/0xca72b3b33563eaee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563eae7 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.631148:0:10343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948400031600/0xca72b3b33563eaee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563eae7 expref: 23 pid: 6507 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432468.631156:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609363200:0@lo:104: 00000100:00100000:2.0:1787432468.631203:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432468.631236:0:10343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484032e4a00/0xca72b3b33563eac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563eabd expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.631244:0:10343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9484032e4a00/0xca72b3b33563eac4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563eabd expref: 23 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432468.631252:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609363328:0@lo:104: 00000100:00100000:2.0:1787432468.631275:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432468.631291:0:10343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948401682200/0xca72b3b33563eaa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563eaa1 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.631298:0:10343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948401682200/0xca72b3b33563eaa8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563eaa1 expref: 23 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432468.631306:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b67100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609363456:0@lo:104: 00010000:00010000:2.0:1787432468.631337:0:10343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948400030000/0xca72b3b33563ea9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563ea93 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.631344:0:10343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948400030000/0xca72b3b33563ea9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563ea93 expref: 23 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432468.631352:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609363584:0@lo:104: 00010000:00010000:2.0:1787432468.631374:0:10343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484032e5c00/0xca72b3b33563ea8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563ea85 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.631381:0:10343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9484032e5c00/0xca72b3b33563ea8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563ea85 expref: 23 pid: 6508 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432468.631387:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609363712:0@lo:104: 00010000:00010000:2.0:1787432468.631407:0:10343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948303013400/0xca72b3b33563ea4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563ea46 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.631415:0:10343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948303013400/0xca72b3b33563ea4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563ea46 expref: 23 pid: 6507 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432468.631423:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b65500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609363840:0@lo:104: 00010000:00010000:2.0:1787432468.631462:0:10343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948303012e00/0xca72b3b33563ea23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563ea1c expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.631471:0:10343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948303012e00/0xca72b3b33563ea23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563ea1c expref: 23 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432468.631479:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609363968:0@lo:104: 00000100:00100000:2.0:1787432468.631501:0:10343:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432468.631925:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787432468.631951:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.631966:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.631976:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.631984:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.631993:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.632002:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609362944 00000100:00100000:3.0:1787432468.632022:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609362944 00000100:00100000:3.0:1787432468.632072:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609363072 00000100:00100000:3.0:1787432468.632076:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609363072 00000100:00100000:3.0:1787432468.632085:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609363200 00000100:00100000:3.0:1787432468.632095:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609363200 00000100:00100000:3.0:1787432468.632108:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609363328 00000100:00100000:3.0:1787432468.632110:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609363328 00000100:00100000:3.0:1787432468.632119:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609363456 00000100:00100000:3.0:1787432468.632121:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609363456 00000100:00100000:3.0:1787432468.632129:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609363584 00000100:00100000:3.0:1787432468.632131:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609363584 00000100:00100000:3.0:1787432468.632154:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609363712 00000100:00100000:3.0:1787432468.632157:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609363712 00000100:00100000:3.0:1787432468.632196:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609363840 00000100:00100000:3.0:1787432468.632198:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609363840 00000100:00100000:3.0:1787432468.632208:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609363968 00000100:00100000:3.0:1787432468.632210:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609363968 00000100:00100000:3.0:1787432468.632222:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787432468.632231:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+11:10343:x1874258609362944:12345-0@lo:104: 00010000:00010000:3.0:1787432468.632245:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563eb26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563eb34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432468.632309:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787432468.632315:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+11:10343:x1874258609362944:12345-0@lo:104: Request processed in 85us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.632322:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787432468.632340:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787432468.632346:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+10:10343:x1874258609363072:12345-0@lo:104: 00010000:00010000:3.0:1787432468.632354:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563eb03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563eb0a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432468.632498:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787432468.632504:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+10:10343:x1874258609363072:12345-0@lo:104: Request processed in 159us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.632520:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787432468.632532:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432468.632538:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+9:10343:x1874258609363200:12345-0@lo:104: 00010000:00010000:3.0:1787432468.632546:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948303013c00/0xca72b3b33563eae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563eaee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432468.632582:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787432468.632586:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+9:10343:x1874258609363200:12345-0@lo:104: Request processed in 49us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.632592:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432468.632603:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787432468.632608:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483032e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+8:10343:x1874258609363328:12345-0@lo:104: 00010000:00010000:3.0:1787432468.632691:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563eabd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563eac4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432468.632720:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787432468.632724:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483032e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+8:10343:x1874258609363328:12345-0@lo:104: Request processed in 116us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.632729:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787432468.632763:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787432468.632770:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+7:10343:x1874258609363456:12345-0@lo:104: 00010000:00010000:3.0:1787432468.632778:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948303012200/0xca72b3b33563eaa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563eaa8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432468.632803:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787432468.632808:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+7:10343:x1874258609363456:12345-0@lo:104: Request processed in 40us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432468.633341:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787432468.633356:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f85b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+7:10343:x1874258609363584:12345-0@lo:104: 00000100:00100000:2.0:1787432468.633620:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b66d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609362944:0@lo:104: 00010000:00010000:1.0:1787432468.633628:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948303012600/0xca72b3b33563ea93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ea9a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432468.633632:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b67800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609363072:0@lo:104: 00000100:00100000:2.0:1787432468.633640:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609363200:0@lo:104: 00000100:00100000:2.0:1787432468.633647:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609363328:0@lo:104: 00000100:00100000:2.0:1787432468.633654:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b67100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609363456:0@lo:104: 00010000:00010000:1.0:1787432468.633669:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1787432468.633671:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609363584:0@lo:104: 00000100:00100000:1.0:1787432468.633674:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f85b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+7:10343:x1874258609363584:12345-0@lo:104: Request processed in 323us (1707us total) trans 0 rc 0/0 00010000:00010000:0.0:1787432468.635333:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787432468.635344:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563eb26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563eb34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.635349:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787432468.635354:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e4c00 already unused, calling callback (ffffffffc122fc20) 00010000:00010000:2.0:1787432468.635355:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563eb03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563eb0a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432468.635359:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563eb26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563eb34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.635362:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e4800 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432468.635365:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563eb03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563eb0a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.635370:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563eb26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563eb34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.635381:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563eb03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563eb0a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432468.635390:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787432468.635433:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787432468.635449:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f859c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+6:10343:x1874258609363712:12345-0@lo:104: 10000000:00010000:0.0:1787432468.635557:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563eb26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563eb34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432468.635573:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 10000000:01000000:0.0:1787432468.635587:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787432468.635594:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787432468.635604:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f859880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+5:10343:x1874258609363840:12345-0@lo:104: 00010000:00010000:3.0:1787432468.635627:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484032e5400/0xca72b3b33563ea46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ea4d expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.635645:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563eb26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563eb34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.635651:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432468.635674:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563eb26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563eb34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.635681:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e4c00/0xca72b3b33563eb26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563eb34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.635697:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787432468.635701:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948303013c00/0xca72b3b33563eae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563eaee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.635707:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013c00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1787432468.635709:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948303013c00/0xca72b3b33563eae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563eaee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432468.635714:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1787432468.635716:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948303013c00/0xca72b3b33563eae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563eaee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432468.635719:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f859880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+5:10343:x1874258609363840:12345-0@lo:104: Request processed in 119us (3733us total) trans 0 rc 0/0 10000000:00010000:0.0:1787432468.635722:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948303013c00/0xca72b3b33563eae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563eaee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432468.635726:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 10000000:01000000:0.0:1787432468.635728:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787432468.635738:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1787432468.635742:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948303013c00/0xca72b3b33563eae7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563eaee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432468.635745:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f85b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:10343:x1874258609363968:12345-0@lo:104: 00010000:00010000:0.0:1787432468.635748:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787432468.635752:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ea1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ea23 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.635768:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948303013c00/0xca72b3b33563eae7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563eaee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.635775:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948303013c00/0xca72b3b33563eae7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563eaee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432468.635777:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787432468.635781:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f85b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:10343:x1874258609363968:12345-0@lo:104: Request processed in 37us (3788us total) trans 0 rc 0/0 00010000:00010000:0.0:1787432468.635784:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00000100:00100000:3.0:1787432468.635787:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1787432468.635787:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563eabd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563eac4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.635793:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e4200 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1787432468.635796:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563eabd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563eac4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.635803:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563eabd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563eac4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432468.635808:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563eabd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563eac4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432468.636080:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432468.636108:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563eabd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563eac4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636114:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432468.636121:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563eabd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563eac4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636126:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e4200/0xca72b3b33563eabd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563eac4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636147:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787432468.636156:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948303012200/0xca72b3b33563eaa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563eaa8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636180:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303012200 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1787432468.636184:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948303012200/0xca72b3b33563eaa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563eaa8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636191:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948303012200/0xca72b3b33563eaa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563eaa8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432468.636196:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948303012200/0xca72b3b33563eaa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563eaa8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432468.636211:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432468.636229:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948303012200/0xca72b3b33563eaa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563eaa8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636244:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432468.636250:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948303012200/0xca72b3b33563eaa1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563eaa8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636256:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948303012200/0xca72b3b33563eaa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563eaa8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636266:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787432468.636269:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948303012600/0xca72b3b33563ea93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ea9a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636275:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303012600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1787432468.636277:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948303012600/0xca72b3b33563ea93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563ea9a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636294:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948303012600/0xca72b3b33563ea93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563ea9a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432468.636301:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948303012600/0xca72b3b33563ea93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563ea9a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432468.636306:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432468.636320:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948303012600/0xca72b3b33563ea93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ea9a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636326:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432468.636330:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948303012600/0xca72b3b33563ea93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ea9a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636336:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948303012600/0xca72b3b33563ea93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ea9a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636344:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1787432468.636346:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b65500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609363840:0@lo:104: 00010000:00010000:0.0:1787432468.636347:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e5400/0xca72b3b33563ea46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ea4d expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636353:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e5400 already unused, calling callback (ffffffffc122fc20) 00000100:00100000:3.0:1787432468.636355:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609363968:0@lo:104: 10000000:00010000:0.0:1787432468.636356:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e5400/0xca72b3b33563ea46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563ea4d expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636362:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e5400/0xca72b3b33563ea46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563ea4d expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432468.636368:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e5400/0xca72b3b33563ea46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563ea4d expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432468.636379:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432468.636393:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484032e5400/0xca72b3b33563ea46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ea4d expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636399:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432468.636403:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e5400/0xca72b3b33563ea46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ea4d expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636410:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e5400/0xca72b3b33563ea46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ea4d expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636419:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432468.636422:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ea1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ea23 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636428:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948401683000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1787432468.636431:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ea1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563ea23 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636437:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ea1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563ea23 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432468.636443:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ea1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563ea23 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432468.636448:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432468.636458:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ea1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ea23 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636465:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432468.636476:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ea1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ea23 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636482:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ea1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ea23 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.636490:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432468.636492:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432468.636494:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432468.636504:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432468.636536:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609364096:0@lo:103: 00000100:00100000:0.0:1787432468.636598:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432468.636659:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609364608:0@lo:103: 00000100:00100000:0.0:1787432468.636682:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432468.636710:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432468.636715:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609364480:0@lo:103: 00000100:00100000:0.0:1787432468.636735:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432468.636764:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609364224:0@lo:103: 10000000:00010000:2.0:1787432468.636780:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563eb03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563eb0a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432468.636785:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1787432468.636789:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787432468.636802:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609364736:0@lo:103: 00010000:00010000:2.0:1787432468.636809:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563eb03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563eb0a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.636827:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432468.636844:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563eb03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563eb0a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.636851:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e4800/0xca72b3b33563eb03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563eb0a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432468.636869:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432468.636871:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432468.636873:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432468.636992:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432468.637008:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787432468.637015:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609364352:0@lo:103: 00000100:00100000:0.0:1787432468.637038:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432468.637047:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609364864:0@lo:103: 00000100:00100000:3.0:1787432468.637052:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609364096 00000100:00100000:3.0:1787432468.637059:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609364096 00000100:00100000:0.0:1787432468.637063:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432468.637086:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609364608 00010000:00010000:3.0:1787432468.637092:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948303013800/0xca72b3b33563eb34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563eb26 expref: 24 pid: 6508 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432468.637095:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609364608 00010000:00010000:0.0:1787432468.637107:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948400030000/0xca72b3b33563ea9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ea93 expref: 25 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432468.637110:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609364480 00000100:00100000:3.0:1787432468.637117:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609364480 00000100:00100000:0.0:1787432468.637118:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609364224 00000100:00100000:0.0:1787432468.637120:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609364224 00010000:00010000:0.0:1787432468.637128:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948400031600/0xca72b3b33563eaee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563eae7 expref: 27 pid: 6507 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432468.637129:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948401682200/0xca72b3b33563eaa8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563eaa1 expref: 27 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432468.637151:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609364352 00000100:00100000:0.0:1787432468.637151:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609364736 00000100:00100000:0.0:1787432468.637153:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609364736 00000100:00100000:3.0:1787432468.637154:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609364352 00010000:00010000:0.0:1787432468.637180:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948303013400/0xca72b3b33563ea4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ea46 expref: 29 pid: 6507 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432468.637186:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484032e4a00/0xca72b3b33563eac4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563eabd expref: 29 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432468.637191:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609364864 00000100:00100000:0.0:1787432468.637194:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609364864 00000100:00100000:3.0:1787432468.637199:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787432468.637204:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948303012e00/0xca72b3b33563ea23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ea1c expref: 30 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432468.637206:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94841223d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+30:3642:x1874258609364096:12345-0@lo:103: 00000100:00100000:0.0:1787432468.637215:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1787432468.637216:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787432468.637219:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+30:3642:x1874258609364608:12345-0@lo:103: 00010000:00010000:3.0:1787432468.637221:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948303013800/0xca72b3b33563eb34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563eb26 expref: 30 pid: 6508 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.637226:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432468.637229:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948400030000/0xca72b3b33563ea9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ea93 expref: 30 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432468.637230:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948303013800/0xca72b3b33563eb34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563eb26 expref: 30 pid: 6508 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432468.637246:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303013800/0xca72b3b33563eb34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563eb26 expref: 30 pid: 6508 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432468.637259:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432468.637286:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94841223d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+29:3642:x1874258609364096:12345-0@lo:103: Request processed in 81us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.637292:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787432468.637333:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432468.637340:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+28:3643:x1874258609364224:12345-0@lo:103: 00010000:00010000:3.0:1787432468.637346:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432468.637352:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948400031600/0xca72b3b33563eaee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563eae7 expref: 28 pid: 6507 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432468.637384:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948400031600/0xca72b3b33563eaee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563eae7 expref: 28 pid: 6507 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432468.637395:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948400031600/0xca72b3b33563eaee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563eae7 expref: 28 pid: 6507 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432468.637405:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432468.637441:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+27:3643:x1874258609364224:12345-0@lo:103: Request processed in 102us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.637446:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432468.637461:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787432468.637467:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+26:3642:x1874258609364480:12345-0@lo:103: 00010000:00010000:3.0:1787432468.637474:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432468.637478:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948401682200/0xca72b3b33563eaa8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563eaa1 expref: 26 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432468.637487:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948401682200/0xca72b3b33563eaa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563eaa1 expref: 26 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432468.637543:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609364224:0@lo:103: 00010000:00010000:1.0:1787432468.638556:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563ea85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ea8c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432468.638633:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787432468.638640:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f859c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:10343:x1874258609363712:12345-0@lo:104: Request processed in 3198us (6661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432468.638660:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1787432468.638774:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948400030000/0xca72b3b33563ea9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563ea93 expref: 26 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.638789:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948400030000/0xca72b3b33563ea9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563ea93 expref: 26 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.638802:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432468.638832:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+25:3642:x1874258609364608:12345-0@lo:103: Request processed in 1611us (2148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432468.638839:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787432468.638908:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787432468.638917:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609364736:12345-0@lo:103: 00010000:00010000:0.0:1787432468.638926:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432468.638931:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948303013400/0xca72b3b33563ea4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ea46 expref: 24 pid: 6507 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.638940:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948303013400/0xca72b3b33563ea4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563ea46 expref: 24 pid: 6507 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.638950:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303013400/0xca72b3b33563ea4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563ea46 expref: 24 pid: 6507 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.638959:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432468.639043:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:3643:x1874258609364736:12345-0@lo:103: Request processed in 128us (2051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432468.639050:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787432468.639063:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787432468.639070:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:3643:x1874258609364352:12345-0@lo:103: 00010000:00010000:0.0:1787432468.639077:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432468.639151:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484032e4a00/0xca72b3b33563eac4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563eabd expref: 22 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.639161:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484032e4a00/0xca72b3b33563eac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563eabd expref: 22 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.639187:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e4a00/0xca72b3b33563eac4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563eabd expref: 22 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.639309:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432468.639334:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:3643:x1874258609364352:12345-0@lo:103: Request processed in 264us (2295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432468.639340:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787432468.639352:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787432468.639358:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:3643:x1874258609364864:12345-0@lo:103: 00010000:00010000:0.0:1787432468.639364:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432468.639368:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948303012e00/0xca72b3b33563ea23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ea1c expref: 20 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.639376:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948303012e00/0xca72b3b33563ea23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563ea1c expref: 20 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.639386:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303012e00/0xca72b3b33563ea23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563ea1c expref: 20 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.639394:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432468.639413:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:3643:x1874258609364864:12345-0@lo:103: Request processed in 55us (2348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432468.639418:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787432468.639448:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609364992:0@lo:103: 00000100:00100000:0.0:1787432468.639476:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432468.639535:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609364096:0@lo:103: 00000100:00100000:0.0:1787432468.639543:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609364608:0@lo:103: 00010000:00010000:0.0:1787432468.639563:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432468.639569:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563ea85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ea8c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.639582:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948401683a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1787432468.639586:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563ea85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563ea8c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.639595:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563ea85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563ea8c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432468.639602:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563ea85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563ea8c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432468.639608:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432468.639636:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563ea85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ea8c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.639642:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432468.639654:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563ea85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ea8c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.639662:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948401683a00/0xca72b3b33563ea85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ea8c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.639677:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432468.639678:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432468.639680:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432468.639687:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432468.639695:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609365120:0@lo:103: 00000100:00100000:0.0:1787432468.639718:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432468.639740:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609364992 00000100:00100000:0.0:1787432468.639745:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609364992 00010000:00010000:0.0:1787432468.639771:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484032e5600/0xca72b3b33563eb0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563eb03 expref: 19 pid: 6508 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432468.639789:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609365120 00000100:00100000:0.0:1787432468.639791:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609365120 00010000:00010000:0.0:1787432468.639799:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484032e5c00/0xca72b3b33563ea8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ea85 expref: 20 pid: 6508 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432468.639809:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787432468.639814:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94841223e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:3641:x1874258609364992:12345-0@lo:103: 00010000:00010000:0.0:1787432468.639821:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432468.639824:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484032e5600/0xca72b3b33563eb0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563eb03 expref: 20 pid: 6508 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.639832:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484032e5600/0xca72b3b33563eb0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563eb03 expref: 20 pid: 6508 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.639843:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e5600/0xca72b3b33563eb0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563eb03 expref: 20 pid: 6508 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.639851:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432468.639979:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609364352:0@lo:103: 00000100:00100000:1.0:1787432468.639988:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609364864:0@lo:103: 00000100:00100000:1.0:1787432468.639996:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609364736:0@lo:103: 00000100:00100000:0.0:1787432468.640540:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94841223e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:3641:x1874258609364992:12345-0@lo:103: Request processed in 722us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432468.640548:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787432468.640567:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787432468.640575:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:3641:x1874258609365120:12345-0@lo:103: 00010000:00010000:0.0:1787432468.640586:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432468.640591:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484032e5c00/0xca72b3b33563ea8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ea85 expref: 18 pid: 6508 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.640615:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484032e5c00/0xca72b3b33563ea8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563ea85 expref: 18 pid: 6508 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.640628:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432468.640654:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:3641:x1874258609365120:12345-0@lo:103: Request processed in 80us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432468.640659:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787432468.640762:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609365120:0@lo:103: 00010000:00010000:2.0:1787432468.640763:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e5c00/0xca72b3b33563ea8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563ea85 expref: 17 pid: 6508 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432468.640770:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609364992:0@lo:103: 00000100:00100000:2.0:1787432468.640775:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609363712:0@lo:104: 00010000:00010000:3.0:1787432468.641385:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948401682200/0xca72b3b33563eaa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563eaa1 expref: 16 pid: 6506 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432468.641399:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432468.641476:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:3642:x1874258609364480:12345-0@lo:103: Request processed in 4009us (4740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.641484:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787432468.641572:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609364480:0@lo:103: 00000100:00100000:2.0:1787432468.642562:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b67480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609362688:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432468.642575:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10343:1874258609362816:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432468.642637:0:10343:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94843f85e200/0xca72b3b33563eb88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432468.644638:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432468.644739:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432468.645387:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588340864 00000100:00100000:1.0:1787432468.645402:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588340864 00010000:00010000:1.0:1787432468.645450:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484013fd400/0xca72b3b33563eb49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4bfc expref: 10 pid: 6507 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432468.645527:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588340992 00000100:00100000:1.0:1787432468.645530:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588340992 00010000:00010000:1.0:1787432468.645544:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948401683200/0xca72b3b33563eb42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4bf5 expref: 11 pid: 6506 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432468.645567:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 33 00000100:00100000:1.0:1787432468.645577:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a40dc378-0ae8-4eb1-a992-02a683490593+11:2402:x1874258588340864:12345-192.168.204.24@tcp:103: 00010000:00010000:1.0:1787432468.645593:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432468.645599:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484013fd400/0xca72b3b33563eb49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4bfc expref: 11 pid: 6507 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432468.645612:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484013fd400/0xca72b3b33563eb49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4bfc expref: 11 pid: 6507 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432468.645631:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fd400/0xca72b3b33563eb49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4bfc expref: 11 pid: 6507 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432468.645661:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432468.645736:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a40dc378-0ae8-4eb1-a992-02a683490593+10:2402:x1874258588340864:12345-192.168.204.24@tcp:103: Request processed in 159us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432468.645744:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 33 00000100:00100000:1.0:1787432468.645766:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 34 00000100:00100000:1.0:1787432468.645773:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f858700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a40dc378-0ae8-4eb1-a992-02a683490593+9:2402:x1874258588340992:12345-192.168.204.24@tcp:103: 00010000:00010000:1.0:1787432468.645781:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432468.645785:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948401683200/0xca72b3b33563eb42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4bf5 expref: 9 pid: 6506 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432468.645793:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948401683200/0xca72b3b33563eb42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4bf5 expref: 9 pid: 6506 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432468.645803:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948401683200/0xca72b3b33563eb42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4bf5 expref: 9 pid: 6506 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432468.645944:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94843f85e200/0xca72b3b33563eb88 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432468.645954:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94843f85e200/0xca72b3b33563eb88 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432468.645972:0:7465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94843f85e200/0xca72b3b33563eb88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432468.645980:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94843f85e200/0xca72b3b33563eb88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432468.645988:0:7465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94843f85e200/0xca72b3b33563eb88 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432468.646002:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94843f85e200/0xca72b3b33563eb88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432468.646009:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432468.646013:0:7465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94843f85e200/0xca72b3b33563eb88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432468.646032:0:7465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94843f85e200/0xca72b3b33563eb88 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432468.646052:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94843f85e200/0xca72b3b33563eb88 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432468.646066:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432468.646192:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f858700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a40dc378-0ae8-4eb1-a992-02a683490593+8:2402:x1874258588340992:12345-192.168.204.24@tcp:103: Request processed in 418us (1452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432468.646199:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 34 00010000:00010000:0.0:1787432468.647312:0:10343:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94843f85e200/0xca72b3b33563eb88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.647328:0:10343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94843f85e200/0xca72b3b33563eb88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.647335:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94843f85e200/0xca72b3b33563eb88 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432468.687579:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432468.939477:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609365376:0@lo:13: 00000100:00100000:3.0:1787432468.939547:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.939596:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609365888:0@lo:400: 00000100:00100000:3.0:1787432468.939622:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.939639:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609366400:0@lo:400: 00000100:00100000:3.0:1787432468.939665:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.939683:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609366912:0@lo:400: 00000100:00100000:3.0:1787432468.939721:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.939753:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787432468.939759:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609365248:0@lo:13: 00000100:00100000:3.0:1787432468.943581:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.943664:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609365760:0@lo:400: 00000100:00100000:3.0:1787432468.943732:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.943760:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609366272:0@lo:400: 00000100:00100000:3.0:1787432468.943802:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.943829:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609366784:0@lo:400: 00000100:00100000:3.0:1787432468.943853:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.943893:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609365504:0@lo:400: 00000100:00100000:3.0:1787432468.943941:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.943966:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609366016:0@lo:400: 00000100:00100000:3.0:1787432468.943992:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.944012:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609366528:0@lo:400: 00000100:00100000:3.0:1787432468.944036:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.944057:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609367040:0@lo:400: 00000100:00100000:3.0:1787432468.944111:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.944153:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787432468.944161:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609365632:0@lo:400: 00000100:00100000:3.0:1787432468.944208:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.944226:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609366144:0@lo:400: 00000100:00100000:3.0:1787432468.944266:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.944294:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609366656:0@lo:400: 00000100:00100000:3.0:1787432468.944316:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432468.944351:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609365376 00000100:00100000:3.0:1787432468.944363:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609365376 00000100:00100000:3.0:1787432468.944426:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609365248 00000100:00100000:3.0:1787432468.944429:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609365248 00000100:00100000:3.0:1787432468.944448:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432468.944458:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609365376:12345-0@lo:13: 00002000:00000024:3.0:1787432468.944497:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432468.944550:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609365376:12345-0@lo:13: Request processed in 93us (5003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.944558:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432468.944576:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787432468.944583:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609365248:12345-0@lo:13: 00002000:00000024:3.0:1787432468.944593:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432468.944618:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609365248:12345-0@lo:13: Request processed in 36us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.944624:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787432468.944643:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609365888 00000100:00100000:3.0:1787432468.944647:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609365888 00000100:00100000:3.0:1787432468.944667:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609366272 00000100:00100000:3.0:1787432468.944677:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609366272 00000100:00100000:3.0:1787432468.944695:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609366784 00000100:00100000:3.0:1787432468.944698:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609366784 00000100:00100000:3.0:1787432468.944709:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609365632 00000100:00100000:3.0:1787432468.944711:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609365632 00000100:00100000:3.0:1787432468.944721:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609366144 00000100:00100000:3.0:1787432468.944724:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609366144 00000100:00100000:3.0:1787432468.944735:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609366656 00000100:00100000:3.0:1787432468.944738:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609366656 00000100:00100000:3.0:1787432468.944754:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787432468.944761:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609365888:12345-0@lo:400: 00000100:00100000:1.0:1787432468.944782:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609365760 00000100:00100000:1.0:1787432468.944789:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609365760 00000100:00100000:3.0:1787432468.944802:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609365888:12345-0@lo:400: Request processed in 40us (5177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.944809:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787432468.944825:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787432468.944832:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609366272:12345-0@lo:400: 00000100:00100000:3.0:1787432468.944858:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609366272:12345-0@lo:400: Request processed in 27us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.944864:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787432468.944875:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787432468.944881:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609366784:12345-0@lo:400: 00000100:00100000:3.0:1787432468.944907:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609366784:12345-0@lo:400: Request processed in 26us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.944913:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787432468.944924:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787432468.944931:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609365632:12345-0@lo:400: 00000100:00100000:3.0:1787432468.944962:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609365632:12345-0@lo:400: Request processed in 32us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432468.944965:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609366016 00000100:00100000:1.0:1787432468.944971:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609366016 00000100:00100000:3.0:1787432468.944981:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787432468.944996:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787432468.945001:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787432468.945011:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609366144:12345-0@lo:400: 00000100:00100000:3.0:1787432468.945041:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609366144:12345-0@lo:400: Request processed in 33us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.945047:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787432468.945058:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787432468.945065:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f92bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609366656:12345-0@lo:400: 00000100:00100000:1.0:1787432468.945088:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609365760:12345-0@lo:400: 00000100:00100000:3.0:1787432468.945093:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f92bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609366656:12345-0@lo:400: Request processed in 26us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.945100:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787432468.945121:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609366400 00000100:00100000:3.0:1787432468.945141:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609366400 00000100:00100000:1.0:1787432468.945153:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609365760:12345-0@lo:400: Request processed in 147us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432468.945161:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787432468.945187:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609366912 00000100:00100000:3.0:1787432468.945192:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609366912 00000100:00100000:1.0:1787432468.945200:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787432468.945211:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609366528 00000100:00100000:1.0:1787432468.945211:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609366016:12345-0@lo:400: 00000100:00100000:3.0:1787432468.945216:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609366528 00000100:00100000:3.0:1787432468.945230:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609367040 00000100:00100000:3.0:1787432468.945235:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609367040 00000100:00100000:3.0:1787432468.945250:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787432468.945260:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609366400:12345-0@lo:400: 00000100:00100000:1.0:1787432468.945267:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609366016:12345-0@lo:400: Request processed in 56us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432468.945275:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787432468.945304:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609366400:12345-0@lo:400: Request processed in 45us (5637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.945311:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787432468.945323:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787432468.945329:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609366912:12345-0@lo:400: 00000100:00100000:3.0:1787432468.945355:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609366912:12345-0@lo:400: Request processed in 28us (5634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.945367:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787432468.945378:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787432468.945384:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609366528:12345-0@lo:400: 00000100:00100000:3.0:1787432468.945410:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609366528:12345-0@lo:400: Request processed in 27us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.945416:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787432468.945426:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787432468.945432:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609367040:12345-0@lo:400: 00000100:00100000:3.0:1787432468.945455:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609367040:12345-0@lo:400: Request processed in 24us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.945460:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787432468.945492:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609365504 00000100:00100000:3.0:1787432468.945496:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609365504 00000100:00100000:3.0:1787432468.945532:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787432468.945539:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:3641:x1874258609365504:12345-0@lo:400: 00000100:00100000:3.0:1787432468.945569:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:3641:x1874258609365504:12345-0@lo:400: Request processed in 31us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432468.945575:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:3.0:1787432468.945619:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432468.945623:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432468.945626:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432468.945656:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609365632:0@lo:400: 00000100:00100000:3.0:1787432468.945668:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609366144:0@lo:400: 00000100:00100000:3.0:1787432468.945678:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609366656:0@lo:400: 00000100:00100000:3.0:1787432468.945688:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609365504:0@lo:400: 00000100:00100000:3.0:1787432468.945710:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609366016:0@lo:400: 00010000:00080000:3.0:1787432468.945722:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435b64700 x1874258609366528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432468.945732:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609366528:0@lo:400: 00010000:00080000:3.0:1787432468.945744:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435b64e00 x1874258609367040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432468.945753:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609367040:0@lo:400: 00010000:00080000:3.0:1787432468.946023:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f85ad80 x1874258609365248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432468.946039:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609365248:0@lo:13: 00000100:00100000:3.0:1787432468.946050:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609365760:0@lo:400: 00010000:00080000:3.0:1787432468.946060:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435b64000 x1874258609366272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432468.946068:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609366272:0@lo:400: 00010000:00080000:3.0:1787432468.946077:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435b64a80 x1874258609366784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432468.946085:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609366784:0@lo:400: 00010000:00080000:3.0:1787432468.946095:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484359e8000 x1874258609365376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432468.946104:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609365376:0@lo:13: 00000100:00100000:3.0:1787432468.946116:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609365888:0@lo:400: 00010000:00080000:3.0:1787432468.946150:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435b67480 x1874258609366400/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432468.946158:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609366400:0@lo:400: 00010000:00080000:3.0:1787432468.946190:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435b67100 x1874258609366912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432468.946198:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609366912:0@lo:400: 00000100:00100000:3.0:1787432469.015327:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432469.015376:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432469.015427:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432469.015462:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432469.015497:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432469.015540:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588341248 00000100:00100000:3.0:1787432469.015555:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588341248 00000100:00100000:3.0:1787432469.015631:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588341376 00000100:00100000:3.0:1787432469.015634:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588341376 00000100:00100000:3.0:1787432469.015669:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 69 00000100:00100000:2.0:1787432469.015670:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588341120 00000100:00100000:2.0:1787432469.015677:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588341120 00000100:00100000:3.0:1787432469.015687:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2401:x1874258588341248:12345-192.168.204.24@tcp:400: 00000100:00100000:2.0:1787432469.015717:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 201 00000100:00100000:2.0:1787432469.015725:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+8:2401:x1874258588341120:12345-192.168.204.24@tcp:400: 00000100:00100000:3.0:1787432469.015772:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2401:x1874258588341248:12345-192.168.204.24@tcp:400: Request processed in 91us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432469.015812:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 70 00000100:00100000:1.0:1787432469.015813:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588341504 00000100:00100000:1.0:1787432469.015819:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588341504 00000100:00100000:0.0:1787432469.015825:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588341376:12345-192.168.204.24@tcp:400: 00000100:00100000:3.0:1787432469.015857:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 69 00000100:00100000:1.0:1787432469.015864:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588341632 00000100:00100000:1.0:1787432469.015873:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588341632 00000100:00100000:3.0:1787432469.015889:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00100000:1.0:1787432469.015915:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00100000:3.0:1787432469.015917:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f92b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588341504:12345-192.168.204.24@tcp:400: 00000100:00100000:1.0:1787432469.015927:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588341632:12345-192.168.204.24@tcp:400: 00000100:00100000:2.0:1787432469.016085:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+8:2401:x1874258588341120:12345-192.168.204.24@tcp:400: Request processed in 360us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432469.016093:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 201 00000100:00080000:2.0:1787432469.017960:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787432469.017975:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787432469.017981:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787432469.017985:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432469.019984:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588341376:12345-192.168.204.24@tcp:400: Request processed in 4150us (4507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432469.020000:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 70 00000100:00100000:3.0:1787432469.022868:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f92b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588341504:12345-192.168.204.24@tcp:400: Request processed in 6957us (7478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432469.022885:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00100000:1.0:1787432469.026538:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588341632:12345-192.168.204.24@tcp:400: Request processed in 10600us (11025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432469.026555:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 15 00010000:00010000:2.0:1787432469.711813:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787432470.091610:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787432470.091622:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948435bcb800 from 48 10000000:01000000:0.0:1787432470.091630:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787432470.091723:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563eb8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432470.091760:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563eb8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432470.091775:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563eb8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432470.091813:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609367168:0@lo:101: 00000100:00100000:0.0:1787432470.091901:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432470.093416:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609367168 00000100:00100000:1.0:1787432470.093437:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609367168 00000100:00100000:0.0:1787432470.093437:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432470.104893:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787432470.104946:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+15:6511:x1874258609367168:12345-0@lo:101: 00010000:00010000:1.0:1787432470.104976:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432470.105010:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948401682a00/0xca72b3b33563eb96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563eb8f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.105051:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948401682a00/0xca72b3b33563eb96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563eb8f expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.107016:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948401682a00/0xca72b3b33563eb96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563eb8f expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.107030:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948401682a00, rc 0) 00000100:00100000:1.0:1787432470.107446:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609367168:12345-0@lo:101: Request processed in 2531us (15541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432470.107475:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787432470.107599:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609367168:0@lo:101: 00010000:00010000:0.0:1787432470.107625:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563eb8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eb96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432470.107637:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563eb8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563eb96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432470.107725:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609367296:0@lo:501: 00000100:00100000:0.0:1787432470.107764:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432470.117946:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432470.118029:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609367296 00000100:00100000:2.0:1787432470.118378:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609367296 00000100:00100000:2.0:1787432470.118450:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787432470.118462:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609367296:12345-0@lo:501: 00000100:00100000:2.0:1787432470.118653:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609367296:12345-0@lo:501: Request processed in 194us (10888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432470.118661:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787432470.119188:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609367296:0@lo:501: 00000100:00100000:0.0:1787432470.119268:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609367424:0@lo:503: 00000100:00100000:0.0:1787432470.119332:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432470.119371:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432470.119485:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609367424 00000100:00100000:1.0:1787432470.119495:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609367424 00000100:00100000:3.0:1787432470.119786:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787432470.120571:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609367424:12345-0@lo:503: 00000100:00100000:3.0:1787432470.120738:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609367424:12345-0@lo:503: Request processed in 944us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432470.120746:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787432470.120968:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609367424:0@lo:503: 00000100:00100000:2.0:1787432470.122502:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10360:1874258609367552:0@lo:502: 00000100:00100000:2.0:1787432470.122585:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.122636:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791600 going to sleep for 11 seconds 00000100:00100000:3.0:1787432470.122769:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609367552 00000100:00100000:3.0:1787432470.122777:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609367552 00000100:00100000:3.0:1787432470.122844:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787432470.122855:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:10360:x1874258609367552:12345-0@lo:502: 00000100:00100000:3.0:1787432470.122975:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:10360:x1874258609367552:12345-0@lo:502: Request processed in 121us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432470.122983:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787432470.123500:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10360:1874258609367552:0@lo:502: 00000100:00100000:2.0:1787432470.123548:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10360:1874258609367680:0@lo:502: 00000100:00100000:2.0:1787432470.123585:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.123617:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791600 going to sleep for 11 seconds 00000100:00100000:3.0:1787432470.123727:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609367680 00000100:00100000:3.0:1787432470.123732:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609367680 00000100:00100000:3.0:1787432470.123767:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787432470.123775:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:10360:x1874258609367680:12345-0@lo:502: 00000100:00100000:3.0:1787432470.123917:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:10360:x1874258609367680:12345-0@lo:502: Request processed in 141us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432470.123925:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787432470.127596:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10360:1874258609367680:0@lo:502: 00000040:00080000:2.0:1787432470.128540:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787432470.128677:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787432470.128720:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787432470.128731:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563eb8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eb96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432470.128743:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563eb8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eb96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432470.128754:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787432470.128757:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787432470.128760:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787432470.128796:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563eb9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432470.128804:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563eb9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432470.128813:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563eb9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432470.128834:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609367808:0@lo:101: 00000100:00100000:0.0:1787432470.128907:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432470.128965:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432470.129035:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609367808 00000100:00100000:1.0:1787432470.129042:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609367808 00000100:00100000:1.0:1787432470.129095:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787432470.129116:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+16:6511:x1874258609367808:12345-0@lo:101: 00010000:00010000:1.0:1787432470.129130:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432470.129145:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948401683200/0xca72b3b33563eba4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563eb9d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.129187:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948401683200/0xca72b3b33563eba4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563eb9d expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.129210:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948401683200/0xca72b3b33563eba4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563eb9d expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.129218:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948401683200, rc 0) 00000100:00100000:1.0:1787432470.129266:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609367808:12345-0@lo:101: Request processed in 162us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432470.129273:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787432470.129601:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609367808:0@lo:101: 00010000:00010000:2.0:1787432470.129619:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563eb9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eba4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432470.129630:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563eb9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563eba4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432470.129696:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609367936:0@lo:501: 00000100:00100000:2.0:1787432470.129725:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.129767:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791840 going to sleep for 11 seconds 00000100:00100000:3.0:1787432470.129791:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609367936 00000100:00100000:3.0:1787432470.129807:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609367936 00000100:00100000:3.0:1787432470.129843:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787432470.129852:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609367936:12345-0@lo:501: 00000100:00100000:3.0:1787432470.130043:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609367936:12345-0@lo:501: Request processed in 192us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432470.130051:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787432470.131310:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609367936:0@lo:501: 00000100:00100000:2.0:1787432470.131367:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609368064:0@lo:503: 00000100:00100000:2.0:1787432470.131441:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.131779:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791840 going to sleep for 11 seconds 00000100:00100000:3.0:1787432470.138397:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609368064 00000100:00100000:3.0:1787432470.138430:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609368064 00000100:00100000:3.0:1787432470.138656:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787432470.138671:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609368064:12345-0@lo:503: 00000100:00100000:3.0:1787432470.138919:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609368064:12345-0@lo:503: Request processed in 251us (7477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432470.138927:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787432470.144553:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609368064:0@lo:503: 00000100:00100000:0.0:1787432470.151142:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10361:1874258609368192:0@lo:502: 00000100:00100000:0.0:1787432470.151268:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432470.151314:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787432470.151712:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609368192 00000100:00100000:1.0:1787432470.151720:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609368192 00000100:00100000:1.0:1787432470.151773:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787432470.151783:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:10361:x1874258609368192:12345-0@lo:502: 00000100:00100000:1.0:1787432470.151948:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:10361:x1874258609368192:12345-0@lo:502: Request processed in 167us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432470.151964:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787432470.152215:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10361:1874258609368192:0@lo:502: 00000020:01000000:3.0:1787432470.152252:0:10361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432470.152261:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432470.152264:0:10361:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787432470.152269:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787432470.152300:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f929f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10361:1874258609368320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432470.152339:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432470.152366:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484048c9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432470.152439:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609368320 00000100:00100000:2.0:1787432470.152444:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609368320 00000100:00100000:2.0:1787432470.152482:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787432470.152491:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:10361:x1874258609368320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432470.152572:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:10361:x1874258609368320:12345-0@lo:502:llog_process_th.0 Request processed in 82us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432470.152578:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787432470.152805:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f929f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10361:1874258609368320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787432470.152828:0:10361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432470.152832:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432470.152834:0:10361:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787432470.152837:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1787432470.153017:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787432470.153047:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787432470.153059:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563eb9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eba4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432470.153071:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563eb9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eba4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432470.153082:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787432470.153085:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948435a21000 from 48 10000000:01000000:2.0:1787432470.153088:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787432470.153123:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33563ebab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432470.153140:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33563ebab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432470.153149:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33563ebab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432470.153190:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609368448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787432470.153239:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.153261:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791840 going to sleep for 11 seconds 00000100:00100000:3.0:1787432470.153472:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609368448 00000100:00100000:3.0:1787432470.153479:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609368448 00000100:00100000:3.0:1787432470.153520:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787432470.153528:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+17:6511:x1874258609368448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432470.153540:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432470.153559:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303013800/0xca72b3b33563ebb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ebab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432470.153585:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303013800/0xca72b3b33563ebb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ebab expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432470.153607:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303013800/0xca72b3b33563ebb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ebab expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432470.153618:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303013800, rc 0) 00000100:00100000:3.0:1787432470.153655:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609368448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432470.153661:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787432470.153836:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609368448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432470.153852:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33563ebab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432470.153864:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33563ebab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ebb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432470.153930:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609368576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432470.153957:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.153980:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791840 going to sleep for 11 seconds 00000100:00100000:3.0:1787432470.154022:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609368576 00000100:00100000:3.0:1787432470.154036:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609368576 00000100:00100000:3.0:1787432470.154063:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787432470.154070:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609368576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432470.154563:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609368576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 492us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432470.154571:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787432470.154678:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609368576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432470.154714:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609368704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432470.154761:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.154789:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791840 going to sleep for 11 seconds 00000100:00100000:1.0:1787432470.154850:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609368704 00000100:00100000:1.0:1787432470.154855:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609368704 00000100:00100000:1.0:1787432470.154893:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787432470.154901:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609368704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432470.155002:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609368704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432470.155010:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787432470.155424:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609368704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432470.155873:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10362:1874258609368832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432470.155919:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.155955:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432470.155999:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609368832 00000100:00100000:1.0:1787432470.156004:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609368832 00000100:00100000:1.0:1787432470.156156:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787432470.156191:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:10362:x1874258609368832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432470.156316:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:10362:x1874258609368832:12345-0@lo:502:llog_process_th.0 Request processed in 151us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432470.156324:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787432470.156413:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10362:1874258609368832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432470.156451:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10362:1874258609368960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432470.156496:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432470.162793:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609368960 00000100:00100000:3.0:1787432470.162848:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609368960 00000100:00100000:3.0:1787432470.168471:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787432470.168514:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:10362:x1874258609368960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432470.168761:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:10362:x1874258609368960:12345-0@lo:502:llog_process_th.0 Request processed in 269us (12263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432470.168771:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787432470.169559:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432470.169606:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10362:1874258609368960:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787432470.169651:0:10362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787432470.170838:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787432470.170878:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787432470.170893:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33563ebab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.170909:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33563ebab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432470.170922:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787432470.170926:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787432470.170929:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787432470.170980:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401682c00/0xca72b3b33563ebb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.170999:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948401682c00/0xca72b3b33563ebb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.171009:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948401682c00/0xca72b3b33563ebb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432470.171030:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609369088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787432470.171088:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432470.171135:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948302715600 going to sleep for 11 seconds 00000100:00100000:2.0:1787432470.171326:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609369088 00000100:00100000:2.0:1787432470.171339:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609369088 00000100:00100000:2.0:1787432470.171388:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787432470.171398:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+18:6511:x1874258609369088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432470.171411:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432470.171425:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94843f85e000/0xca72b3b33563ebc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ebb9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432470.171449:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94843f85e000/0xca72b3b33563ebc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ebb9 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432470.171460:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94843f85e000/0xca72b3b33563ebc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ebb9 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432470.171483:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e000, rc 0) 00000100:00100000:2.0:1787432470.171531:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:6511:x1874258609369088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432470.171538:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787432470.171704:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609369088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432470.171720:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948401682c00/0xca72b3b33563ebb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebc0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.171728:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948401682c00/0xca72b3b33563ebb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ebc0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432470.171789:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609369216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432470.171812:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432470.171843:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948302715600 going to sleep for 11 seconds 00000100:00100000:2.0:1787432470.171895:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609369216 00000100:00100000:2.0:1787432470.171899:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609369216 00000100:00100000:0.0:1787432470.172472:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787432470.172486:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:6511:x1874258609369216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432470.172626:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:6511:x1874258609369216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432470.172648:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787432470.172824:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609369216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432470.174530:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609369344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432470.174655:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432470.176946:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948302715600 going to sleep for 11 seconds 00000100:00100000:3.0:1787432470.177269:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609369344 00000100:00100000:3.0:1787432470.177281:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609369344 00000100:00100000:3.0:1787432470.177374:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787432470.177385:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:6511:x1874258609369344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432470.177847:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:6511:x1874258609369344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 462us (3190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432470.177856:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787432470.180707:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609369344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432470.182009:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10363:1874258609369472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432470.182353:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432470.182489:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483027150c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432470.186750:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609369472 00000100:00100000:3.0:1787432470.186773:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609369472 00000100:00100000:3.0:1787432470.186856:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787432470.186870:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:10363:x1874258609369472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432470.187109:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:10363:x1874258609369472:12345-0@lo:502:llog_process_th.0 Request processed in 233us (4748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432470.187117:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787432470.187375:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10363:1874258609369472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787432470.187412:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432470.187421:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432470.187424:0:10363:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787432470.187430:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787432470.187467:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10363:1874258609369600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432470.187513:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432470.187553:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483027150c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432470.187769:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609369600 00000100:00100000:2.0:1787432470.187775:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609369600 00000100:00100000:2.0:1787432470.187815:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787432470.187822:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:10363:x1874258609369600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432470.187922:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:10363:x1874258609369600:12345-0@lo:502:llog_process_th.0 Request processed in 100us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432470.187939:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787432470.188096:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10363:1874258609369600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787432470.188125:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432470.188130:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432470.188131:0:10363:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787432470.188136:0:10363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1787432470.188837:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787432470.188862:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787432470.188873:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401682c00/0xca72b3b33563ebb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebc0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432470.188886:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948401682c00/0xca72b3b33563ebb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebc0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432470.188896:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787432470.188900:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94842dfc5000 from 48 10000000:01000000:2.0:1787432470.188903:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787432470.188934:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33563ebc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432470.188943:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33563ebc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432470.188951:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33563ebc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432470.188971:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609369728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787432470.189017:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.189052:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791600 going to sleep for 11 seconds 00000100:00100000:1.0:1787432470.189312:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609369728 00000100:00100000:1.0:1787432470.189321:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609369728 00000100:00100000:1.0:1787432470.189366:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787432470.189375:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:6511:x1874258609369728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432470.189386:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432470.189401:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948401683800/0xca72b3b33563ebce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ebc7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.189422:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948401683800/0xca72b3b33563ebce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ebc7 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.189430:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948401683800/0xca72b3b33563ebce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ebc7 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.189452:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948401683800, rc 0) 00000100:00100000:1.0:1787432470.189528:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609369728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432470.189535:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787432470.190522:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609369728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432470.190546:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33563ebc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432470.190670:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33563ebc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ebce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432470.190781:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609369856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432470.190823:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.190861:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791600 going to sleep for 11 seconds 00000100:00100000:0.0:1787432470.190918:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609369856 00000100:00100000:0.0:1787432470.190923:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609369856 00000100:00100000:0.0:1787432470.190968:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787432470.190978:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609369856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432470.191247:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609369856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432470.191254:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787432470.191366:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609369856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432470.191392:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609369984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432470.191430:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.191449:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791600 going to sleep for 11 seconds 00000100:00100000:1.0:1787432470.191502:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609369984 00000100:00100000:1.0:1787432470.191507:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609369984 00000100:00100000:1.0:1787432470.191543:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787432470.191549:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609369984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432470.191744:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609369984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432470.191751:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787432470.191819:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609369984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432470.192705:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10364:1874258609370112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432470.192761:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.192798:0:10364:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432470.192952:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609370112 00000100:00100000:0.0:1787432470.192957:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609370112 00000100:00100000:0.0:1787432470.193030:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787432470.193038:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:10364:x1874258609370112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432470.193289:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:10364:x1874258609370112:12345-0@lo:502:llog_process_th.0 Request processed in 250us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432470.193295:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787432470.193375:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10364:1874258609370112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432470.193418:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10364:1874258609370240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432470.193447:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.196763:0:10364:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb116c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432470.196941:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609370240 00000100:00100000:3.0:1787432470.196953:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609370240 00000100:00100000:3.0:1787432470.197044:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787432470.197056:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:10364:x1874258609370240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432470.197399:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:10364:x1874258609370240:12345-0@lo:502:llog_process_th.0 Request processed in 344us (3949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432470.197408:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787432470.197661:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10364:1874258609370240:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787432470.197709:0:10364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787432470.198333:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787432470.198362:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787432470.198375:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33563ebc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432470.198388:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33563ebc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432470.198398:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787432470.198400:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1787432470.198414:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787432470.198452:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303012a00/0xca72b3b33563ebd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432470.198461:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948303012a00/0xca72b3b33563ebd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432470.198471:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948303012a00/0xca72b3b33563ebd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432470.198492:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609370368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432470.198544:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432470.198704:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484052ec300 going to sleep for 11 seconds 00000100:00100000:1.0:1787432470.198770:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609370368 00000100:00100000:1.0:1787432470.198778:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609370368 00000100:00100000:2.0:1787432470.198845:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787432470.198859:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609370368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432470.198881:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432470.198898:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94843f85f600/0xca72b3b33563ebdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ebd5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432470.198928:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94843f85f600/0xca72b3b33563ebdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ebd5 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432470.198940:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94843f85f600/0xca72b3b33563ebdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ebd5 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432470.198950:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85f600, rc 0) 00000100:00100000:2.0:1787432470.199041:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609370368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432470.199048:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787432470.199333:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609370368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432470.199351:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948303012a00/0xca72b3b33563ebd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebdc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432470.199362:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948303012a00/0xca72b3b33563ebd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ebdc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432470.199421:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609370496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432470.199449:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432470.199509:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484052ec300 going to sleep for 11 seconds 00000100:00100000:2.0:1787432470.199549:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609370496 00000100:00100000:2.0:1787432470.199625:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609370496 00000100:00100000:2.0:1787432470.199692:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787432470.199700:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609370496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432470.199843:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609370496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432470.199851:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787432470.199914:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609370496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432470.199946:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609370624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432470.199998:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432470.200194:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484052ec300 going to sleep for 11 seconds 00000100:00100000:1.0:1787432470.200376:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609370624 00000100:00100000:1.0:1787432470.200382:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609370624 00000100:00100000:1.0:1787432470.200408:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787432470.200415:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609370624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432470.200548:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609370624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432470.200635:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787432470.200715:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609370624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432470.201152:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10365:1874258609370752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432470.201243:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.201272:0:10365:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432470.201399:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609370752 00000100:00100000:1.0:1787432470.201403:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609370752 00000100:00100000:1.0:1787432470.201425:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787432470.201431:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:10365:x1874258609370752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432470.201519:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:10365:x1874258609370752:12345-0@lo:502:llog_process_th.0 Request processed in 88us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432470.201532:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787432470.204814:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10365:1874258609370752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432470.204891:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432470.204914:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432470.204932:0:10365:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787432470.204938:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787432470.204992:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10365:1874258609370880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432470.206261:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.206342:0:10365:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484164a3000 going to sleep for 11 seconds 00000100:00100000:3.0:1787432470.206497:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609370880 00000100:00100000:3.0:1787432470.206510:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609370880 00000100:00100000:3.0:1787432470.206571:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787432470.206580:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:10365:x1874258609370880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432470.206787:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:10365:x1874258609370880:12345-0@lo:502:llog_process_th.0 Request processed in 207us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432470.206796:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787432470.209133:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10365:1874258609370880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432470.209228:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432470.209243:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432470.209245:0:10365:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787432470.209250:0:10365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1787432470.209590:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1787432470.209625:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787432470.209640:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303012a00/0xca72b3b33563ebd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebdc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.209654:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948303012a00/0xca72b3b33563ebd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebdc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432470.209667:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787432470.209670:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948411b1c000 from 48 10000000:01000000:1.0:1787432470.209673:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787432470.209723:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401682200/0xca72b3b33563ebe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.209732:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948401682200/0xca72b3b33563ebe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.209742:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948401682200/0xca72b3b33563ebe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432470.209766:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609371008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787432470.209852:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432470.209897:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948302715600 going to sleep for 11 seconds 00000100:00100000:3.0:1787432470.209984:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609371008 00000100:00100000:3.0:1787432470.209993:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609371008 00000100:00100000:3.0:1787432470.210049:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787432470.210059:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609371008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432470.210085:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432470.210099:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303013200/0xca72b3b33563ebea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ebe3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432470.210136:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303013200/0xca72b3b33563ebea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ebe3 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432470.210146:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303013200/0xca72b3b33563ebea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ebe3 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432470.210155:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303013200, rc 0) 00000100:00100000:3.0:1787432470.210243:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609371008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432470.210251:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787432470.210725:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609371008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432470.210751:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948401682200/0xca72b3b33563ebe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432470.210762:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948401682200/0xca72b3b33563ebe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ebea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432470.210834:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609371136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432470.210870:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.210895:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484164a3000 going to sleep for 11 seconds 00000100:00100000:0.0:1787432470.210972:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609371136 00000100:00100000:0.0:1787432470.210978:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609371136 00000100:00100000:1.0:1787432470.211098:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787432470.211116:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609371136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432470.211286:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609371136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432470.211317:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787432470.211474:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609371136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432470.211508:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609371264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432470.211556:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.211586:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484164a3000 going to sleep for 11 seconds 00000100:00100000:0.0:1787432470.211646:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609371264 00000100:00100000:0.0:1787432470.211651:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609371264 00000100:00100000:0.0:1787432470.211674:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787432470.211681:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609371264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432470.211787:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609371264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432470.211795:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787432470.211880:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609371264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432470.215841:0:10366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10366:1874258609371392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432470.216045:0:10366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.216289:0:10366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484164a3840 going to sleep for 11 seconds 00000100:00100000:0.0:1787432470.216422:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609371392 00000100:00100000:0.0:1787432470.216431:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609371392 00000100:00100000:1.0:1787432470.216608:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787432470.216620:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:10366:x1874258609371392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432470.216914:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:10366:x1874258609371392:12345-0@lo:502:llog_process_th.0 Request processed in 294us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432470.216924:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787432470.217423:0:10366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10366:1874258609371392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432470.217488:0:10366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10366:1874258609371520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432470.217539:0:10366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.217610:0:10366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484164a3840 going to sleep for 11 seconds 00000100:00100000:1.0:1787432470.217713:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609371520 00000100:00100000:1.0:1787432470.217718:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609371520 00000100:00100000:1.0:1787432470.217808:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787432470.217820:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:10366:x1874258609371520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432470.217963:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:10366:x1874258609371520:12345-0@lo:502:llog_process_th.0 Request processed in 145us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432470.217971:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787432470.218244:0:10366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10366:1874258609371520:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787432470.218285:0:10366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787432470.218579:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787432470.218599:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787432470.218617:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401682200/0xca72b3b33563ebe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432470.218701:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948401682200/0xca72b3b33563ebe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432470.218713:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787432470.218716:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1787432470.218719:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787432470.218756:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303013a00/0xca72b3b33563ebf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432470.218765:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948303013a00/0xca72b3b33563ebf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432470.218775:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948303013a00/0xca72b3b33563ebf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432470.218794:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609371648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432470.218843:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432470.218920:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484052ec900 going to sleep for 11 seconds 00000100:00100000:1.0:1787432470.219391:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609371648 00000100:00100000:1.0:1787432470.219399:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609371648 00000100:00100000:1.0:1787432470.219495:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787432470.219508:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609371648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432470.219522:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432470.219543:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948401683a00/0xca72b3b33563ebf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ebf1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.219578:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948401683a00/0xca72b3b33563ebf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ebf1 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.219589:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948401683a00/0xca72b3b33563ebf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ebf1 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432470.219613:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948401683a00, rc 0) 00000100:00100000:1.0:1787432470.219682:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609371648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432470.219689:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787432470.219769:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f929f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609371648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432470.219786:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948303013a00/0xca72b3b33563ebf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebf8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432470.219793:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948303013a00/0xca72b3b33563ebf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ebf8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432470.219870:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609371776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432470.219904:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432470.220421:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787432470.220517:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609371776 00000100:00100000:3.0:1787432470.220523:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609371776 00000100:00100000:3.0:1787432470.220561:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787432470.220570:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609371776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432470.220741:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609371776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432470.220749:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787432470.220902:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609371776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432470.220950:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609371904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432470.221009:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432470.221032:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787432470.221201:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609371904 00000100:00100000:3.0:1787432470.221215:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609371904 00000100:00100000:3.0:1787432470.221240:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787432470.221246:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609371904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432470.221341:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609371904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432470.221348:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787432470.221449:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609371904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432470.221987:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10367:1874258609372032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432470.222028:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432470.222069:0:10367:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432470.222186:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609372032 00000100:00100000:3.0:1787432470.222190:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609372032 00000100:00100000:3.0:1787432470.222213:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787432470.222220:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:10367:x1874258609372032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432470.222317:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:10367:x1874258609372032:12345-0@lo:502:llog_process_th.0 Request processed in 97us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432470.222325:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787432470.222410:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10367:1874258609372032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787432470.222437:0:10367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432470.222446:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432470.222449:0:10367:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787432470.222455:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787432470.222474:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10367:1874258609372160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432470.222507:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432470.222540:0:10367:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432470.222586:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609372160 00000100:00100000:3.0:1787432470.222590:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609372160 00000100:00100000:3.0:1787432470.222607:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787432470.222614:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948406122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:10367:x1874258609372160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432470.222765:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948406122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:10367:x1874258609372160:12345-0@lo:502:llog_process_th.0 Request processed in 150us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432470.222771:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787432470.222851:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10367:1874258609372160:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787432470.222870:0:10367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432470.222874:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432470.222876:0:10367:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787432470.222880:0:10367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787432470.223341:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1787432470.223368:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787432470.223383:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303013a00/0xca72b3b33563ebf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebf8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432470.223395:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948303013a00/0xca72b3b33563ebf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebf8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432470.223422:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787432470.223425:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9484336199b8 from 1 10000000:01000000:3.0:1787432470.223429:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787432470.223457:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303012c00/0xca72b3b33563ebff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432470.223465:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948303012c00/0xca72b3b33563ebff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432470.223475:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948303012c00/0xca72b3b33563ebff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432470.223493:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f929180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609372288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432470.223536:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432470.223573:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484052ec540 going to sleep for 11 seconds 00000100:00100000:0.0:1787432470.223693:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609372288 00000100:00100000:0.0:1787432470.223698:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609372288 00000100:00100000:0.0:1787432470.223739:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787432470.223747:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948406120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609372288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432470.223759:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432470.223773:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484013fcc00/0xca72b3b33563ec06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ebff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432470.223801:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fcc00/0xca72b3b33563ec06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ebff expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432470.223812:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484013fcc00/0xca72b3b33563ec06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ebff expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432470.223822:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fcc00, rc 0) 00000100:00100000:0.0:1787432470.223858:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948406120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609372288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432470.223863:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787432470.223963:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f929180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609372288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432470.223977:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948303012c00/0xca72b3b33563ebff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ec06 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432470.223987:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948303012c00/0xca72b3b33563ebff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ec06 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432470.224040:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f929180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609372416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432470.224146:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432470.224190:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484052ec540 going to sleep for 11 seconds 00000100:00100000:0.0:1787432470.224241:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609372416 00000100:00100000:0.0:1787432470.224244:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609372416 00000100:00100000:0.0:1787432470.224270:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787432470.224276:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948406122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609372416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432470.224352:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948406122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609372416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (205us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787432470.224369:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787432470.224462:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f929180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609372416:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787432470.224488:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787432470.224500:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303012c00/0xca72b3b33563ebff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ec06 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432470.224508:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948303012c00/0xca72b3b33563ebff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ec06 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432470.475543:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609372544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432470.475641:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432470.476954:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609372544 00000100:00100000:2.0:1787432470.476969:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609372544 00000100:00100000:2.0:1787432470.477040:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787432470.477051:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609372544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787432470.477106:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787432470.477223:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609372544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 173us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432470.477230:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787432470.477540:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609372544:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787432470.731540:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432471.755438:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432472.781125:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432473.547459:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609372800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432473.547529:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432473.547537:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432473.547547:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609372928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787432473.547586:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432473.547655:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609372800 00000100:00100000:3.0:1787432473.547663:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609372800 00000100:00100000:3.0:1787432473.547713:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609372928 00000100:00100000:3.0:1787432473.547717:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609372928 00000100:00080000:2.0:1787432473.547735:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432473.547740:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787432473.547751:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609372800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432473.547793:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432473.547838:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609372672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432473.547873:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432473.547911:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609372672 00000100:00100000:2.0:1787432473.547915:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609372672 00000100:00100000:2.0:1787432473.547941:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787432473.547947:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609372672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787432473.547972:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787432473.548023:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609372672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432473.548031:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787432473.548087:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609372672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432473.554627:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609372800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6853us (7066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432473.554645:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787432473.554650:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039b5500 x1874258609372800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432473.554684:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609372800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432473.554693:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787432473.554713:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f92a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609372928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787432473.554745:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432473.554826:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f92a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609372928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (7240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432473.554849:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787432473.554948:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f929500 x1874258609372928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432473.554962:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609372928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432473.623363:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432473.623518:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588341760 00000100:00100000:0.0:1787432473.623529:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588341760 00000100:00100000:0.0:1787432473.623586:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 244 00000100:00100000:0.0:1787432473.623596:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+8:6175:x1874258588341760:12345-192.168.204.24@tcp:101: 00010000:00010000:0.0:1787432473.623612:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432473.623628:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484013fc800/0xca72b3b33563ec0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4c6c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432473.623662:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fc800/0xca72b3b33563ec0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c6c expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432473.623673:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484013fc800/0xca72b3b33563ec0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c6c expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432473.623684:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fc800, rc 0) 00000100:00100000:0.0:1787432473.623835:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+9:6175:x1874258588341760:12345-192.168.204.24@tcp:101: Request processed in 239us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432473.623842:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 244 00000100:00100000:2.0:1787432473.636579:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432473.636687:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588341888 00000100:00100000:1.0:1787432473.636700:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588341888 00000100:00100000:1.0:1787432473.636773:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 245 00000100:00100000:1.0:1787432473.636785:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+9:6175:x1874258588341888:12345-192.168.204.24@tcp:501: 00000100:00100000:1.0:1787432473.636981:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+9:6175:x1874258588341888:12345-192.168.204.24@tcp:501: Request processed in 197us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432473.636991:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 245 00000100:00100000:2.0:1787432473.640311:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432473.640479:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588342016 00000100:00100000:1.0:1787432473.640493:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588342016 00000100:00100000:1.0:1787432473.640566:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 246 00000100:00100000:1.0:1787432473.640585:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+9:6175:x1874258588342016:12345-192.168.204.24@tcp:503: 00000100:00100000:1.0:1787432473.640746:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+9:6175:x1874258588342016:12345-192.168.204.24@tcp:503: Request processed in 169us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432473.640754:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 246 00000100:00100000:2.0:1787432473.651979:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432473.652839:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588342144 00000100:00100000:0.0:1787432473.652856:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588342144 00000100:00100000:0.0:1787432473.652930:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 247 00000100:00100000:0.0:1787432473.652943:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+9:6686:x1874258588342144:12345-192.168.204.24@tcp:502: 00000100:00100000:0.0:1787432473.653156:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+9:6686:x1874258588342144:12345-192.168.204.24@tcp:502: Request processed in 215us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432473.653200:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 247 00000100:00100000:3.0:1787432473.665660:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432473.666221:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588342272 00000100:00100000:2.0:1787432473.666234:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588342272 00000100:00100000:2.0:1787432473.666309:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 248 00000100:00100000:2.0:1787432473.666319:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+9:6686:x1874258588342272:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787432473.666503:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+9:6686:x1874258588342272:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 185us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432473.666512:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 248 00000100:00100000:2.0:1787432473.669656:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432473.670046:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588342400 00000100:00100000:1.0:1787432473.670058:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588342400 00000100:00100000:1.0:1787432473.670122:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 249 00000100:00100000:1.0:1787432473.670135:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+9:6175:x1874258588342400:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432473.670158:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432473.670218:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948401683c00/0xca72b3b33563ec14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4c73 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432473.670299:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948401683c00/0xca72b3b33563ec14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c73 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432473.670311:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948401683c00/0xca72b3b33563ec14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c73 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432473.670321:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948401683c00, rc 0) 00000100:00100000:1.0:1787432473.670397:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+10:6175:x1874258588342400:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 264us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432473.670403:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 249 00000100:00100000:1.0:1787432473.677115:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432473.677205:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588342528 00000100:00100000:0.0:1787432473.677215:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588342528 00000100:00100000:0.0:1787432473.677282:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 250 00000100:00100000:0.0:1787432473.677292:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405079c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:6175:x1874258588342528:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432473.677409:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405079c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:6175:x1874258588342528:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 118us (303us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787432473.677417:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 250 00010000:00010000:0.0:1787432473.805156:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432474.059834:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609373184:0@lo:400:kworker.0 00000100:00100000:3.0:1787432474.060089:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432474.060234:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609373184 00000100:00100000:1.0:1787432474.060245:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609373184 00000100:00100000:2.0:1787432474.060353:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f92a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609373056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432474.060393:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432474.060461:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609373696:0@lo:400:kworker.0 00000100:00100000:3.0:1787432474.060490:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432474.060510:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609374208:0@lo:400:kworker.0 00000100:00100000:3.0:1787432474.060530:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432474.060546:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609374720:0@lo:400:kworker.0 00000100:00100000:3.0:1787432474.060562:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432474.060581:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787432474.060587:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609373312:0@lo:400:kworker.0 00000100:00100000:3.0:1787432474.060623:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432474.060640:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609373824:0@lo:400:kworker.0 00000100:00100000:3.0:1787432474.060660:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432474.060672:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609374336:0@lo:400:kworker.0 00000100:00100000:3.0:1787432474.060690:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432474.060705:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609374848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432474.060723:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432474.072842:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609374208 00000100:00100000:0.0:1787432474.072859:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609374208 00000100:00100000:0.0:1787432474.072932:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609374720 00000100:00100000:0.0:1787432474.072936:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609374720 00000100:00100000:0.0:1787432474.072983:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787432474.072994:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f92b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609374208:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787432474.073389:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432474.073407:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609373312 00000100:00100000:2.0:1787432474.073413:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609373312 00000100:00100000:3.0:1787432474.073437:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609373696 00000100:00100000:3.0:1787432474.073444:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609373696 00000100:00100000:2.0:1787432474.073448:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609373824 00000100:00100000:2.0:1787432474.073454:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609373824 00000100:00100000:3.0:1787432474.073463:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787432474.073479:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609374336 00000100:00100000:3.0:1787432474.073484:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609374720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432474.073484:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609374336 00000100:00100000:2.0:1787432474.073510:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787432474.073518:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f92ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609373312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432474.073639:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787432474.073649:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840507ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609373184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432474.081407:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609374720:12345-0@lo:400:kworker.0 Request processed in 7915us (20822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432474.081440:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787432474.081501:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787432474.081516:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609373824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432474.081584:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609373824:12345-0@lo:400:kworker.0 Request processed in 75us (20922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432474.081591:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787432474.081608:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787432474.081616:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609374336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432474.081645:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609374336:12345-0@lo:400:kworker.0 Request processed in 31us (20955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432474.081650:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787432474.081729:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f92ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609373312:12345-0@lo:400:kworker.0 Request processed in 8211us (21103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432474.081737:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1787432474.081762:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432474.081786:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609373568:0@lo:400:kworker.0 00000100:00100000:2.0:1787432474.081826:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432474.081857:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609373568 00000100:00100000:2.0:1787432474.081863:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609373568 00000100:00100000:2.0:1787432474.081902:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787432474.081909:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609373568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432474.081940:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609373568:12345-0@lo:400:kworker.0 Request processed in 32us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432474.081946:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787432474.081970:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609373568:0@lo:400:kworker.0 00000100:00100000:2.0:1787432474.081978:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609374080:0@lo:400:kworker.0 00000100:00100000:2.0:1787432474.082230:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432474.082259:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609374592:0@lo:400:kworker.0 00000100:00100000:2.0:1787432474.082283:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432474.082423:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787432474.082432:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609373440:0@lo:400:kworker.0 00000100:00100000:2.0:1787432474.082463:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432474.082487:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609373440 00000100:00100000:2.0:1787432474.082491:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609373440 00000100:00100000:2.0:1787432474.082523:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787432474.082530:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609373440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432474.082579:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609373440:12345-0@lo:400:kworker.0 Request processed in 50us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432474.082586:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787432474.082614:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609373440:0@lo:400:kworker.0 00000100:00100000:2.0:1787432474.082620:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609373952:0@lo:400:kworker.0 00000100:00100000:2.0:1787432474.082641:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432474.082662:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609373952 00000100:00100000:2.0:1787432474.082665:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609373952 00000100:00100000:2.0:1787432474.082696:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787432474.082702:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609373952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432474.082733:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609373952:12345-0@lo:400:kworker.0 Request processed in 31us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432474.082738:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1787432474.082753:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787432474.082773:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f8cc700 x1874258609373952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432474.082785:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609373952:0@lo:400:kworker.0 00000100:00100000:2.0:1787432474.082792:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609374464:0@lo:400:kworker.0 00000100:00100000:2.0:1787432474.082813:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432474.082832:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609374464 00000100:00100000:2.0:1787432474.082836:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609374464 00000100:00100000:2.0:1787432474.082863:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787432474.082870:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609374464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432474.082899:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609374464:12345-0@lo:400:kworker.0 Request processed in 30us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432474.082916:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1787432474.082929:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787432474.082947:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f942a00 x1874258609374464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432474.082957:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609374464:0@lo:400:kworker.0 00000100:00100000:3.0:1787432474.083156:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609373824:0@lo:400:kworker.0 00000100:00100000:2.0:1787432474.083157:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609373056 00000100:00100000:2.0:1787432474.083161:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609373056 00000100:00100000:3.0:1787432474.083190:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609374336:0@lo:400:kworker.0 00000100:00100000:2.0:1787432474.083203:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609374848 00010000:00080000:3.0:1787432474.083205:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f940000 x1874258609374720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432474.083205:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609374848 00000100:00100000:3.0:1787432474.083214:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609374720:0@lo:400:kworker.0 00000100:00100000:2.0:1787432474.083226:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787432474.083232:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609373056:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432474.083237:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609373312:0@lo:400:kworker.0 00000100:00100000:1.0:1787432474.083246:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609374080 00002000:00000024:2.0:1787432474.083254:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432474.083265:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609374080 00000100:00100000:3.0:1787432474.083295:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787432474.083297:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609373056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (22903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432474.083303:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609373696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432474.083309:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609374592 00000100:00100000:1.0:1787432474.083314:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609374592 00000100:00100000:1.0:1787432474.083334:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787432474.083346:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609374080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432474.083353:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609373696:12345-0@lo:400:kworker.0 Request processed in 48us (22859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432474.083361:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787432474.083370:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787432474.083387:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787432474.083395:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1874258609374848:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787432474.083402:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609374080:12345-0@lo:400:kworker.0 Request processed in 57us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432474.083406:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609373696:0@lo:400:kworker.0 00002000:00000024:2.0:1787432474.083406:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432474.083418:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787432474.083439:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432474.083441:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787432474.083447:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1874258609374848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (22721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432474.083454:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1874258609374592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432474.083455:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787432474.083457:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303909180 x1874258609374848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432474.083478:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609374848:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787432474.083478:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f92a680 x1874258609373056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432474.083490:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f92a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609373056:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787432474.083506:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405943480 x1874258609374080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432474.083510:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609374592:12345-0@lo:400:kworker.0 Request processed in 60us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432474.083525:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787432474.083534:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609374080:0@lo:400:kworker.0 00010000:00080000:2.0:1787432474.083552:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f943480 x1874258609374592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432474.083559:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609374592:0@lo:400:kworker.0 00000100:00100000:1.0:1787432474.083585:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840507ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609373184:12345-0@lo:400:kworker.0 Request processed in 9936us (23571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432474.083593:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787432474.083606:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609373184:0@lo:400:kworker.0 00000100:00100000:0.0:1787432474.091221:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f92b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609374208:12345-0@lo:400:kworker.0 Request processed in 18218us (30677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432474.091238:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787432474.094679:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f942300 x1874258609374208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432474.094700:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609374208:0@lo:400:kworker.0 00000100:00100000:3.0:1787432474.134648:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432474.134703:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432474.134751:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432474.134785:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432474.134812:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432474.134840:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588342784 00000100:00100000:3.0:1787432474.134851:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588342784 00000100:00100000:3.0:1787432474.134909:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588342912 00000100:00100000:3.0:1787432474.134913:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588342912 00000100:00100000:3.0:1787432474.134935:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 77 00000100:00100000:3.0:1787432474.134945:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588342784:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432474.135117:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588343040 00000100:00100000:1.0:1787432474.135124:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588343040 00000100:00100000:1.0:1787432474.135160:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588343168 00000100:00100000:1.0:1787432474.135195:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588343168 00000100:00100000:1.0:1787432474.135229:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00100000:2.0:1787432474.135230:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 78 00000100:00100000:1.0:1787432474.135240:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588343040:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432474.135247:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588342912:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432474.135351:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588342784:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 406us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432474.135359:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 77 00000100:00080000:3.0:1787432474.135384:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432474.135389:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787432474.135391:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432474.135393:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432474.135435:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:3.0:1787432474.135444:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588343168:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432474.135501:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588342656 00000100:00100000:0.0:1787432474.135507:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588342656 00000100:00100000:0.0:1787432474.135543:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 252 00000100:00100000:0.0:1787432474.135551:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+10:2403:x1874258588342656:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432474.142417:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588342912:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 7159us (7613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432474.142436:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 78 00000100:00100000:1.0:1787432474.145436:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588343040:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 10184us (10718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432474.145453:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00100000:0.0:1787432474.148617:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+10:2403:x1874258588342656:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 13054us (13850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432474.148634:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 252 00000100:00100000:3.0:1787432474.149493:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588343168:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 14044us (14673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432474.149523:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 21 00010000:00010000:1.0:1787432474.828517:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787432475.150645:0:10405:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5b5a8d00 20000000:00000080:1.0:1787432475.150812:0:10405:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94843f92cc00 uarg=0000000000000000 20000000:01000000:1.0:1787432475.150859:0:10405:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787432475.150865:0:10405:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787432475.150870:0:10405:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787432475.152588:0:10406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1787432475.152878:0:10405:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787432475.159505:0:10405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787432475.159551:0:10405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787432475.159570:0:10405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787432475.159666:0:10405:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787432475.159828:0:10405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94843f85fa00/0xca72b3b33563ec1b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432475.159853:0:10405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484013fc200/0xca72b3b33563e8b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e8b0 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432475.159863:0:10405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484032e5800/0xca72b3b33563e8c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e8be expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432475.159881:0:10405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948401682800/0xca72b3b33563e919 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563e912 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432475.159889:0:10405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484032e5200/0xca72b3b33563ea3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ea38 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432475.159955:0:10405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484013fdc00/0xca72b3b33563eb57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c34 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432475.159964:0:10405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94843f85fa00/0xca72b3b33563ec1b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432475.160021:0:10405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484013fdc00/0xca72b3b33563eb57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c34 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432475.160036:0:10405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9484013fdc00/0xca72b3b33563eb57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c34 expref: 9 pid: 6507 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432475.160052:0:10405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1874258609374976:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432475.160315:0:10405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484032e5200/0xca72b3b33563ea3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563ea38 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432475.160325:0:10405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9484032e5200/0xca72b3b33563ea3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563ea38 expref: 23 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432475.160337:0:10405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1874258609375104:0@lo:104: 00000100:00100000:2.0:1787432475.160386:0:10405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432475.160497:0:10405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948401682800/0xca72b3b33563e919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e912 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432475.160513:0:10405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948401682800/0xca72b3b33563e919 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e912 expref: 23 pid: 6508 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432475.160522:0:10405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1874258609375232:0@lo:104: 00000100:00100000:2.0:1787432475.160550:0:10405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432475.160584:0:10405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484032e5800/0xca72b3b33563e8c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e8be expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432475.160637:0:7455:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787432475.160657:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609375104 00000100:00100000:1.0:1787432475.160667:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609375104 00010000:00010000:2.0:1787432475.160673:0:10405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9484032e5800/0xca72b3b33563e8c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e8be expref: 23 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432475.160724:0:10405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1874258609375360:0@lo:104: 00000100:00100000:1.0:1787432475.160734:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609375232 00000100:00100000:1.0:1787432475.160739:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609375232 00000100:00100000:2.0:1787432475.160757:0:10405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432475.160761:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1787432475.160781:0:10405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484013fc200/0xca72b3b33563e8b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563e8b0 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432475.160784:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:10405:x1874258609375104:12345-0@lo:104: 00010000:00010000:1.0:1787432475.160805:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948400030c00/0xca72b3b33563ea38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ea3f expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432475.160839:0:10405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9484013fc200/0xca72b3b33563e8b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563e8b0 expref: 23 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432475.160851:0:10405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1874258609375488:0@lo:104: 00010000:00010000:1.0:1787432475.160871:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787432475.160882:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:10405:x1874258609375104:12345-0@lo:104: Request processed in 102us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432475.160884:0:10405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432475.160895:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787432475.160908:0:10405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484164a3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432475.160917:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609375360 00000100:00100000:1.0:1787432475.160922:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609375360 00000100:00100000:1.0:1787432475.160937:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609375488 00000100:00100000:2.0:1787432475.160938:0:10405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1874258609375104:0@lo:104: 00000100:00100000:1.0:1787432475.160940:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609375488 00000100:00100000:1.0:1787432475.160958:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787432475.160965:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303902050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+5:10405:x1874258609375232:12345-0@lo:104: 00010000:00010000:1.0:1787432475.160974:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948400030e00/0xca72b3b33563e912 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e919 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432475.160991:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787432475.161015:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+5:10405:x1874258609375360:12345-0@lo:104: 00010000:00010000:2.0:1787432475.161025:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948400030200/0xca72b3b33563e8be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e8c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161030:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1787432475.161081:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787432475.161087:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+5:10405:x1874258609375360:12345-0@lo:104: Request processed in 88us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432475.161094:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787432475.161109:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787432475.161116:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:10405:x1874258609375488:12345-0@lo:104: 00010000:00010000:2.0:1787432475.161123:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563e8b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432475.161150:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303902050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:10405:x1874258609375232:12345-0@lo:104: Request processed in 73us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432475.161158:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1787432475.161396:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787432475.161404:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948400030c00/0xca72b3b33563ea38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ea3f expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161413:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030c00 already unused, calling callback (ffffffffc122fc20) 00010000:00010000:2.0:1787432475.161416:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:00010000:1.0:1787432475.161418:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948400030c00/0xca72b3b33563ea38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563ea3f expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432475.161425:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:10405:x1874258609375488:12345-0@lo:104: Request processed in 308us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432475.161433:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1787432475.161446:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948400030c00/0xca72b3b33563ea38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563ea3f expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432475.161455:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948400030c00/0xca72b3b33563ea38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563ea3f expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432475.161462:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787432475.161466:0:10405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1874258609375232:0@lo:104: 00000100:00100000:2.0:1787432475.161477:0:10405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1874258609375360:0@lo:104: 00000100:00100000:2.0:1787432475.161486:0:10405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1874258609375488:0@lo:104: 00010000:00010000:1.0:1787432475.161506:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948400030c00/0xca72b3b33563ea38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ea3f expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161515:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432475.161541:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948400030c00/0xca72b3b33563ea38 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ea3f expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161549:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948400030c00/0xca72b3b33563ea38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ea3f expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432475.161563:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609375616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432475.161566:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787432475.161571:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948400030e00/0xca72b3b33563e912 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e919 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161577:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030e00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432475.161580:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948400030e00/0xca72b3b33563e912 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e919 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161588:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948400030e00/0xca72b3b33563e912 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e919 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432475.161596:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948400030e00/0xca72b3b33563e912 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e919 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432475.161609:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787432475.161629:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948400030e00/0xca72b3b33563e912 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e919 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161636:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432475.161642:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948400030e00/0xca72b3b33563e912 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e919 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161649:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948400030e00/0xca72b3b33563e912 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e919 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161659:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432475.161663:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948400030200/0xca72b3b33563e8be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e8c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161670:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030200 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432475.161673:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948400030200/0xca72b3b33563e8be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e8c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161680:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948400030200/0xca72b3b33563e8be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e8c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432475.161686:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948400030200/0xca72b3b33563e8be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e8c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432475.161692:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787432475.161714:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948400030200/0xca72b3b33563e8be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e8c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161720:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432475.161746:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948400030200/0xca72b3b33563e8be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e8c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161753:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948400030200/0xca72b3b33563e8be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e8c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161764:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432475.161768:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563e8b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563e8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161774:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e5000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432475.161777:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563e8b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563e8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161784:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563e8b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563e8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432475.161791:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563e8b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563e8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432475.161797:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787432475.161811:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563e8b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161817:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432475.161823:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563e8b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161829:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563e8b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563e8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.161846:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432475.161853:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432475.161855:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432475.161864:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432475.161872:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432475.161879:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432475.161887:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609375744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432475.161922:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432475.161960:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609375872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432475.161985:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432475.162028:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432475.162034:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609376000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432475.162438:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432475.162878:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609375616 00000100:00100000:0.0:1787432475.162886:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609375616 00010000:00010000:0.0:1787432475.162917:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484032e5200/0xca72b3b33563ea3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ea38 expref: 24 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432475.162936:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609375744 00000100:00100000:0.0:1787432475.162939:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609375744 00010000:00010000:0.0:1787432475.162949:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948401682800/0xca72b3b33563e919 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e912 expref: 25 pid: 6508 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432475.162959:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609375872 00000100:00100000:0.0:1787432475.162962:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609375872 00010000:00010000:0.0:1787432475.162972:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484032e5800/0xca72b3b33563e8c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e8be expref: 26 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432475.162981:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609376000 00000100:00100000:0.0:1787432475.162984:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609376000 00010000:00010000:0.0:1787432475.162993:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484013fc200/0xca72b3b33563e8b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e8b0 expref: 27 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432475.163015:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787432475.163024:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0f84c3f-71b4-4eda-b290-0af337217d3a+27:3641:x1874258609375616:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432475.163126:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787432475.163135:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f940380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+27:3642:x1874258609375744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432475.163143:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432475.163150:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948401682800/0xca72b3b33563e919 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e912 expref: 27 pid: 6508 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.163198:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948401682800/0xca72b3b33563e919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e912 expref: 27 pid: 6508 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.163216:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948401682800/0xca72b3b33563e919 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e912 expref: 27 pid: 6508 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.163235:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432475.163284:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f940380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+26:3642:x1874258609375744:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432475.163291:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787432475.163313:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787432475.163333:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+25:3643:x1874258609375872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432475.163341:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432475.163345:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484032e5800/0xca72b3b33563e8c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e8be expref: 25 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.163353:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484032e5800/0xca72b3b33563e8c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e8be expref: 25 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.163363:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e5800/0xca72b3b33563e8c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e8be expref: 25 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.163372:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432475.163400:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609375872:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432475.163406:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787432475.163420:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787432475.163426:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94841223f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:3643:x1874258609376000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432475.163433:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432475.163437:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484013fc200/0xca72b3b33563e8b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563e8b0 expref: 23 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.163445:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484013fc200/0xca72b3b33563e8b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563e8b0 expref: 23 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.163454:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fc200/0xca72b3b33563e8b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563e8b0 expref: 23 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432475.163463:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432475.163484:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94841223f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:3643:x1874258609376000:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432475.163496:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787432475.163578:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432475.163614:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609376000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432475.163624:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609375872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432475.163651:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588343296 00000100:00100000:3.0:1787432475.163773:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609375744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432475.163823:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588343296 00010000:00010000:1.0:1787432475.163843:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484013fdc00/0xca72b3b33563eb57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c34 expref: 10 pid: 6507 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432475.163925:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432475.163937:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484032e5200/0xca72b3b33563ea3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ea38 expref: 21 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432475.163946:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484032e5200/0xca72b3b33563ea3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563ea38 expref: 21 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432475.163955:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e5200/0xca72b3b33563ea3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563ea38 expref: 21 pid: 6506 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432475.163964:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432475.164002:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:3641:x1874258609375616:12345-0@lo:103:ldlm_bl.0 Request processed in 980us (2126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432475.164020:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787432475.164066:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 39 00000100:00100000:0.0:1787432475.164072:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f940e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a40dc378-0ae8-4eb1-a992-02a683490593+10:2402:x1874258588343296:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432475.164080:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432475.164085:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484013fdc00/0xca72b3b33563eb57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c34 expref: 10 pid: 6507 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432475.164094:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484013fdc00/0xca72b3b33563eb57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c34 expref: 10 pid: 6507 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432475.164105:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94843f85fa00/0xca72b3b33563ec1b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432475.164114:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94843f85fa00/0xca72b3b33563ec1b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432475.164130:0:7465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94843f85fa00/0xca72b3b33563ec1b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432475.164146:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94843f85fa00/0xca72b3b33563ec1b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432475.164152:0:7465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94843f85fa00/0xca72b3b33563ec1b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432475.164158:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94843f85fa00/0xca72b3b33563ec1b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432475.164180:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fa00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432475.164185:0:7465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94843f85fa00/0xca72b3b33563ec1b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432475.164193:0:7465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94843f85fa00/0xca72b3b33563ec1b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432475.164202:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94843f85fa00/0xca72b3b33563ec1b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432475.164213:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432475.164253:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f940e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a40dc378-0ae8-4eb1-a992-02a683490593+10:2402:x1874258588343296:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 181us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432475.164260:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 39 00010000:00010000:2.0:1787432475.164468:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fdc00/0xca72b3b33563eb57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c34 expref: 9 pid: 6507 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432475.164480:0:10405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1874258609374976:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432475.164505:0:10405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94843f85fa00/0xca72b3b33563ec1b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432475.164526:0:10405:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94843f85fa00/0xca72b3b33563ec1b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432475.164532:0:10405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94843f85fa00/0xca72b3b33563ec1b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432475.164539:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94843f85fa00/0xca72b3b33563ec1b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432475.168590:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609375616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787432475.595983:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432475.596017:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609376128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432475.596089:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432475.596250:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609376128 00000100:00100000:0.0:1787432475.596260:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609376128 00000100:00100000:0.0:1787432475.596330:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787432475.596341:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609376128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432475.596378:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432475.596431:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609376128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432475.596452:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787432475.600764:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609376128:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787432475.851561:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432476.698722:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432476.698768:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588343424 00000100:00100000:3.0:1787432476.698777:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588343424 00000100:00100000:3.0:1787432476.698837:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 253 00000100:00100000:3.0:1787432476.698851:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840507a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+9:6175:x1874258588343424:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432476.698875:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432476.698903:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303012000/0xca72b3b33563ec22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4c7a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432476.698936:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303012000/0xca72b3b33563ec22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c7a expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432476.698950:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303012000/0xca72b3b33563ec22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c7a expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432476.698961:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303012000, rc 0) 00000100:00100000:3.0:1787432476.699031:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840507a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:6175:x1874258588343424:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 183us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432476.699039:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 253 00000100:00100000:2.0:1787432476.719157:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432476.727641:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588343552 00000100:00100000:1.0:1787432476.727657:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588343552 00000100:00100000:1.0:1787432476.727723:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 254 00000100:00100000:1.0:1787432476.727736:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840507a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+10:6175:x1874258588343552:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432476.727915:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840507a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+10:6175:x1874258588343552:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 182us (8769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432476.727924:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 254 00000100:00100000:1.0:1787432476.730498:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432476.730644:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588343680 00000100:00100000:2.0:1787432476.730653:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588343680 00000100:00100000:2.0:1787432476.730707:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 255 00000100:00100000:2.0:1787432476.730719:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+10:6175:x1874258588343680:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432476.730845:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+10:6175:x1874258588343680:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 Request processed in 128us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432476.731038:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 255 00000100:00100000:1.0:1787432476.734144:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432476.734262:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588343808 00000100:00100000:2.0:1787432476.734272:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588343808 00000100:00100000:2.0:1787432476.734322:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 256 00000100:00100000:2.0:1787432476.734334:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:6750:x1874258588343808:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787432476.734489:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:6750:x1874258588343808:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 157us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432476.734498:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 256 00000100:00100000:1.0:1787432476.747879:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432476.747926:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588343936 00000100:00100000:1.0:1787432476.747935:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588343936 00000100:00100000:1.0:1787432476.747997:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 257 00000100:00100000:1.0:1787432476.748007:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+10:6750:x1874258588343936:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787432476.748151:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+10:6750:x1874258588343936:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 144us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432476.748189:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 257 00010000:00010000:1.0:1787432476.876727:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787432477.195287:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787432477.195297:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948435bcb800 from 4 10000000:01000000:2.0:1787432477.195303:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787432477.195358:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33563ec29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432477.195370:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33563ec29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432477.195384:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33563ec29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432477.195415:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609376256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787432477.195488:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432477.195619:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791780 going to sleep for 11 seconds 00000100:00100000:0.0:1787432477.196217:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609376256 00000100:00100000:0.0:1787432477.196229:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609376256 00000100:00100000:0.0:1787432477.196285:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787432477.196296:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609376256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432477.196311:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432477.196327:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484013fdc00/0xca72b3b33563ec30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ec29 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432477.196353:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fdc00/0xca72b3b33563ec30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ec29 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432477.196364:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484013fdc00/0xca72b3b33563ec30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ec29 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432477.196373:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fdc00, rc 0) 00000100:00100000:0.0:1787432477.196440:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609376256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432477.196447:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787432477.196568:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609376256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432477.196590:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33563ec29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ec30 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432477.196600:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33563ec29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ec30 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432477.196802:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609376384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432477.196837:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432477.197041:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791780 going to sleep for 11 seconds 00000100:00100000:1.0:1787432477.201511:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609376384 00000100:00100000:1.0:1787432477.201532:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609376384 00000100:00100000:0.0:1787432477.202236:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787432477.202249:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609376384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432477.202431:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609376384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (5593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432477.202440:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787432477.202642:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609376384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432477.203484:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609376512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432477.203575:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432477.203635:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791780 going to sleep for 11 seconds 00000100:00100000:1.0:1787432477.203686:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609376512 00000100:00100000:1.0:1787432477.203694:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609376512 00000100:00100000:1.0:1787432477.203736:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787432477.203746:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609376512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432477.203871:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609376512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432477.203879:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787432477.203933:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609376512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432477.204489:0:10484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f943800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10484:1874258609376640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432477.204549:0:10484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432477.204582:0:10484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358a9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432477.206276:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609376640 00000100:00100000:2.0:1787432477.206295:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609376640 00000100:00100000:2.0:1787432477.206370:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787432477.206382:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:10484:x1874258609376640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432477.206552:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:10484:x1874258609376640:12345-0@lo:502:llog_process_th.0 Request processed in 171us (2001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432477.206560:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787432477.206673:0:10484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f943800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10484:1874258609376640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787432477.206710:0:10484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432477.206720:0:10484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432477.206723:0:10484:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787432477.206731:0:10484:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948435bcb800 00000020:00000080:1.0:1787432477.206734:0:10484:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787432477.206831:0:10484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f943800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10484:1874258609376768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432477.206875:0:10484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432477.206912:0:10484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358a9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432477.206943:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609376768 00000100:00100000:3.0:1787432477.206954:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609376768 00000100:00100000:3.0:1787432477.206997:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787432477.207003:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:10484:x1874258609376768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432477.207091:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:10484:x1874258609376768:12345-0@lo:502:llog_process_th.0 Request processed in 87us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432477.207098:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787432477.207212:0:10484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f943800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10484:1874258609376768:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787432477.207231:0:10484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432477.207240:0:10484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432477.207241:0:10484:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787432477.207247:0:10484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787432477.207415:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787432477.207436:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787432477.207447:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33563ec29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ec30 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432477.207459:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33563ec29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ec30 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432477.207469:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787432477.207472:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948435a21000 from 4 10000000:01000000:3.0:1787432477.207475:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787432477.207500:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303013000/0xca72b3b33563ec37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432477.207508:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948303013000/0xca72b3b33563ec37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432477.207517:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948303013000/0xca72b3b33563ec37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432477.207531:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609376896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432477.207562:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432477.207590:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358e1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787432477.207644:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609376896 00000100:00100000:0.0:1787432477.207649:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609376896 00000100:00100000:0.0:1787432477.207690:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787432477.207697:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609376896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432477.207706:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432477.207720:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484013fce00/0xca72b3b33563ec3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ec37 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432477.207743:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484013fce00/0xca72b3b33563ec3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ec37 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432477.207755:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484013fce00/0xca72b3b33563ec3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ec37 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432477.207765:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fce00, rc 0) 00000100:00100000:0.0:1787432477.207800:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609376896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432477.207807:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787432477.208007:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609376896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432477.208027:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948303013000/0xca72b3b33563ec37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ec3e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432477.208036:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948303013000/0xca72b3b33563ec37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ec3e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432477.208091:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609377024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432477.208120:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432477.208141:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358e1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787432477.208808:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609377024 00000100:00100000:0.0:1787432477.208817:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609377024 00000100:00100000:0.0:1787432477.208936:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787432477.208947:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609377024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432477.209080:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609377024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432477.209086:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787432477.210011:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609377024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432477.210073:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609377152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432477.210199:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432477.210242:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358e1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787432477.210987:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609377152 00000100:00100000:0.0:1787432477.211005:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609377152 00000100:00100000:0.0:1787432477.211066:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787432477.211076:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609377152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432477.211265:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609377152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432477.211273:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787432477.211457:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609377152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432477.211987:0:10485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f941880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10485:1874258609377280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432477.212048:0:10485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432477.212094:0:10485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358a9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432477.212805:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609377280 00000100:00100000:3.0:1787432477.212815:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609377280 00000100:00100000:3.0:1787432477.212955:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787432477.212976:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:10485:x1874258609377280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432477.213147:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:10485:x1874258609377280:12345-0@lo:502:llog_process_th.0 Request processed in 181us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432477.213157:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787432477.213328:0:10485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f941880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10485:1874258609377280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787432477.213368:0:10485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432477.213381:0:10485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432477.213384:0:10485:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787432477.213394:0:10485:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948435a21000 00000020:00000080:1.0:1787432477.213397:0:10485:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787432477.213494:0:10485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f941880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10485:1874258609377408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432477.213556:0:10485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432477.213583:0:10485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358a9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432477.214038:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609377408 00000100:00100000:0.0:1787432477.214045:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609377408 00000100:00100000:0.0:1787432477.214457:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787432477.214467:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:10485:x1874258609377408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432477.214632:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:10485:x1874258609377408:12345-0@lo:502:llog_process_th.0 Request processed in 165us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432477.214640:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787432477.214791:0:10485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f941880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10485:1874258609377408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787432477.214825:0:10485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432477.214833:0:10485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432477.214836:0:10485:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787432477.215980:0:10485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787432477.216824:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787432477.216851:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787432477.216862:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303013000/0xca72b3b33563ec37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ec3e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432477.216874:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948303013000/0xca72b3b33563ec37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ec3e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432477.216885:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787432477.216943:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94842dfc5000 from 4 10000000:01000000:1.0:1787432477.216946:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787432477.216997:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ec45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432477.217005:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ec45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432477.217015:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ec45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432477.217040:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f943100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609377536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787432477.217110:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432477.217746:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358a9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432477.221693:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609377536 00000100:00100000:3.0:1787432477.221713:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609377536 00000100:00100000:3.0:1787432477.221802:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787432477.221817:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609377536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432477.221854:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432477.221877:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303013600/0xca72b3b33563ec4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ec45 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432477.221910:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303013600/0xca72b3b33563ec4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ec45 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432477.221921:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303013600/0xca72b3b33563ec4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ec45 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432477.221930:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303013600, rc 0) 00000100:00100000:3.0:1787432477.222024:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609377536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (4914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432477.222030:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787432477.222095:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f943100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609377536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432477.222118:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ec45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ec4c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432477.222128:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ec45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ec4c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432477.222250:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609377664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432477.222288:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432477.222342:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358e1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432477.222365:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609377664 00000100:00100000:3.0:1787432477.222369:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609377664 00000100:00100000:3.0:1787432477.222396:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787432477.222402:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609377664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432477.222529:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609377664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432477.222536:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787432477.222569:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609377664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432477.222598:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609377792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432477.222639:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432477.222653:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358e1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432477.222666:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609377792 00000100:00100000:3.0:1787432477.222670:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609377792 00000100:00100000:3.0:1787432477.222691:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787432477.222698:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609377792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432477.222781:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609377792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432477.222788:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787432477.222833:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609377792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432477.223046:0:10487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10487:1874258609377920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432477.223078:0:10487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432477.223095:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609377920 00000100:00100000:3.0:1787432477.223098:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609377920 00000100:00100000:3.0:1787432477.223115:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787432477.223121:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:10487:x1874258609377920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432477.223220:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:10487:x1874258609377920:12345-0@lo:502:llog_process_th.0 Request processed in 98us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432477.223227:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787432477.223255:0:10487:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb11780 going to sleep for 11 seconds 00000100:00100000:3.0:1787432477.223266:0:10487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10487:1874258609377920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787432477.223286:0:10487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432477.223295:0:10487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432477.223298:0:10487:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787432477.223305:0:10487:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94842dfc5000 00000020:00000080:3.0:1787432477.223307:0:10487:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787432477.223368:0:10487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10487:1874258609378048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432477.223396:0:10487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432477.223413:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609378048 00000100:00100000:3.0:1787432477.223416:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609378048 00000100:00100000:3.0:1787432477.223436:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787432477.223442:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:10487:x1874258609378048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432477.223494:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:10487:x1874258609378048:12345-0@lo:502:llog_process_th.0 Request processed in 52us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432477.223501:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787432477.223526:0:10487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358e1840 going to sleep for 11 seconds 00000100:00100000:3.0:1787432477.223537:0:10487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10487:1874258609378048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787432477.223553:0:10487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432477.223557:0:10487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432477.223558:0:10487:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787432477.223561:0:10487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787432477.223605:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787432477.223629:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787432477.223638:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ec45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ec4c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432477.223646:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ec45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ec4c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432477.223656:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787432477.223659:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948411b1c000 from 4 10000000:01000000:3.0:1787432477.223662:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787432477.223683:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303012800/0xca72b3b33563ec53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432477.223691:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948303012800/0xca72b3b33563ec53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432477.223699:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948303012800/0xca72b3b33563ec53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432477.223711:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609378176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432477.223735:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432477.223748:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb11780 going to sleep for 11 seconds 00000100:00100000:3.0:1787432477.223761:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609378176 00000100:00100000:3.0:1787432477.223764:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609378176 00000100:00100000:3.0:1787432477.223783:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787432477.223789:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609378176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432477.223797:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432477.223810:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303012400/0xca72b3b33563ec5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ec53 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432477.223838:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303012400/0xca72b3b33563ec5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ec53 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432477.223848:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303012400/0xca72b3b33563ec5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ec53 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432477.223856:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303012400, rc 0) 00000100:00100000:3.0:1787432477.223886:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609378176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432477.223892:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787432477.223920:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609378176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432477.223930:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948303012800/0xca72b3b33563ec53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ec5a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432477.223938:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948303012800/0xca72b3b33563ec53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ec5a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432477.223987:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609378304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432477.224010:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432477.224021:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb11780 going to sleep for 11 seconds 00000100:00100000:3.0:1787432477.224032:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609378304 00000100:00100000:3.0:1787432477.224035:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609378304 00000100:00100000:3.0:1787432477.224053:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787432477.224059:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609378304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432477.224129:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609378304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432477.224143:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787432477.224187:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609378304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432477.224210:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609378432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432477.224244:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432477.224257:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb11780 going to sleep for 11 seconds 00000100:00100000:3.0:1787432477.224270:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609378432 00000100:00100000:3.0:1787432477.224273:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609378432 00000100:00100000:3.0:1787432477.224292:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787432477.224298:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609378432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432477.224360:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609378432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432477.224367:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787432477.224402:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609378432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432477.235460:0:10488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10488:1874258609378560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432477.235563:0:10488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432477.235609:0:10488:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432477.235661:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609378560 00000100:00100000:3.0:1787432477.235677:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609378560 00000100:00100000:3.0:1787432477.235732:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787432477.235743:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:10488:x1874258609378560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432477.236039:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:10488:x1874258609378560:12345-0@lo:502:llog_process_th.0 Request processed in 297us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432477.236048:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787432477.236135:0:10488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10488:1874258609378560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432477.236192:0:10488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432477.236203:0:10488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432477.236205:0:10488:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787432477.236213:0:10488:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948411b1c000 00000020:00000080:2.0:1787432477.236216:0:10488:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787432477.236301:0:10488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10488:1874258609378688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432477.236339:0:10488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432477.236356:0:10488:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432477.237387:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609378688 00000100:00100000:3.0:1787432477.237397:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609378688 00000100:00100000:3.0:1787432477.237445:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787432477.237455:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:10488:x1874258609378688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432477.237600:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:10488:x1874258609378688:12345-0@lo:502:llog_process_th.0 Request processed in 147us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432477.237608:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787432477.237744:0:10488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:10488:1874258609378688:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432477.237780:0:10488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432477.237788:0:10488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432477.237791:0:10488:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787432477.237797:0:10488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787432477.241355:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787432477.241394:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787432477.241408:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303012800/0xca72b3b33563ec53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ec5a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432477.241421:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948303012800/0xca72b3b33563ec53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ec5a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432477.905382:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432478.667478:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609378816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432478.667558:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432478.667823:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609378816 00000100:00100000:0.0:1787432478.667835:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609378816 00000100:00100000:0.0:1787432478.667965:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787432478.667978:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609378816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787432478.668020:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432478.668083:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609378816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432478.668092:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787432478.668184:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830390a300 x1874258609378816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432478.668204:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609378816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432478.669382:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432478.669399:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609378944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432478.669450:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432478.669493:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609378944 00000100:00100000:2.0:1787432478.669498:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609378944 00000100:00100000:0.0:1787432478.669583:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432478.669594:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609379072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432478.669633:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432478.669676:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609379072 00000100:00100000:0.0:1787432478.669680:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609379072 00000100:00100000:0.0:1787432478.669718:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787432478.669728:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609379072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432478.669770:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787432478.669811:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609379072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432478.669818:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787432478.669857:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609379072:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1787432478.674369:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432478.674534:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787432478.674553:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609378944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432478.674588:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432478.676045:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609378944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1490us (6585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432478.676057:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787432478.687004:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039b5880 x1874258609378944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432478.687035:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609378944:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787432478.925649:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432479.179364:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432479.179393:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609379200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432479.179467:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432479.179544:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609379200 00000100:00100000:3.0:1787432479.179553:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609379200 00000100:00100000:3.0:1787432479.179619:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787432479.179632:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f85b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609379200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787432479.179660:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432479.179707:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f85b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609379200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432479.179715:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787432479.179779:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f858700 x1874258609379200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432479.179802:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609379200:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787432479.180774:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432479.180958:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609379456:0@lo:400:kworker.0 00000100:00100000:1.0:1787432479.180990:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609379712:0@lo:400:kworker.0 00000100:00100000:3.0:1787432479.181034:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432479.181040:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609379328:0@lo:400:kworker.0 00000100:00100000:2.0:1787432479.182252:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609379456 00000100:00100000:2.0:1787432479.182268:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609379456 00000100:00100000:2.0:1787432479.182343:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787432479.182358:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609379456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432479.183542:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609379968:0@lo:400:kworker.0 00000100:00100000:1.0:1787432479.184018:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432479.184020:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432479.184064:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609379840:0@lo:400:kworker.0 00000100:00100000:1.0:1787432479.184099:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432479.184131:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609380352:0@lo:400:kworker.0 00000100:00100000:1.0:1787432479.184190:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432479.184234:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609379840 00000100:00100000:1.0:1787432479.184240:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609379840 00000100:00100000:1.0:1787432479.184284:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787432479.184294:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609379840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432479.184336:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609380480:0@lo:400:kworker.0 00000100:00100000:1.0:1787432479.184354:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609379840:12345-0@lo:400:kworker.0 Request processed in 60us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432479.184364:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787432479.184375:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432479.184397:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432479.184407:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787432479.184418:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609379584:0@lo:400:kworker.0 00000100:00100000:1.0:1787432479.184430:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609380224:0@lo:400:kworker.0 00000100:00100000:3.0:1787432479.184450:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432479.184465:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432479.184475:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609380096:0@lo:400:kworker.0 00000100:00100000:1.0:1787432479.184490:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609380736:0@lo:400:kworker.0 00000100:00100000:3.0:1787432479.184503:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432479.184517:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609380608:0@lo:400:kworker.0 00000100:00100000:0.0:1787432479.184870:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609379968 00000100:00100000:0.0:1787432479.184875:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609379968 00000100:00100000:0.0:1787432479.184916:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609380480 00000100:00100000:0.0:1787432479.184923:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609380480 00000100:00100000:0.0:1787432479.184950:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609379712 00000100:00100000:0.0:1787432479.184953:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609379712 00000100:00100000:0.0:1787432479.184963:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609380096 00000100:00100000:0.0:1787432479.184966:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609380096 00000100:00100000:0.0:1787432479.184985:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787432479.184992:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609379968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432479.189130:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609379456:12345-0@lo:400:kworker.0 Request processed in 6768us (8088us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432479.189147:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787432479.189210:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787432479.189230:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609380480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432479.189281:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609380480:12345-0@lo:400:kworker.0 Request processed in 58us (4907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432479.189287:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787432479.189301:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787432479.189307:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609379712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432479.189336:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609379712:12345-0@lo:400:kworker.0 Request processed in 29us (4940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432479.189368:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787432479.189381:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787432479.189395:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609380096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432479.189432:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609380096:12345-0@lo:400:kworker.0 Request processed in 44us (4928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432479.189438:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787432479.197083:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432479.197114:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432479.197201:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609379712:0@lo:400:kworker.0 00000100:00100000:1.0:1787432479.197220:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432479.197231:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609380864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432479.197267:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432479.197282:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609380608 00000100:00100000:3.0:1787432479.197292:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609380608 00000100:00100000:1.0:1787432479.197312:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609380352 00000100:00100000:1.0:1787432479.197318:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609380352 00000100:00100000:1.0:1787432479.197358:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609380224 00000100:00100000:3.0:1787432479.197362:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787432479.197363:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609380224 00000100:00100000:3.0:1787432479.197380:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609380608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432479.197380:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609380736 00000100:00100000:1.0:1787432479.197384:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609380736 00000100:00100000:1.0:1787432479.197404:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787432479.197411:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609380352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432479.197452:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609380608:12345-0@lo:400:kworker.0 Request processed in 77us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432479.197459:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609380352:12345-0@lo:400:kworker.0 Request processed in 46us (13293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432479.197466:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787432479.197471:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787432479.197490:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787432479.197497:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609380224:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787432479.197537:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435b64e00 x1874258609380608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432479.197856:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609380608:0@lo:400:kworker.0 00000100:00100000:3.0:1787432479.197875:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609379456:0@lo:400:kworker.0 00000100:00100000:3.0:1787432479.197888:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609380480:0@lo:400:kworker.0 00010000:00080000:3.0:1787432479.197946:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435b67100 x1874258609380096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432479.197956:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609380096:0@lo:400:kworker.0 00000100:00100000:2.0:1787432479.198253:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787432479.198265:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609380736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432479.198316:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609380736:12345-0@lo:400:kworker.0 Request processed in 55us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432479.198322:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787432479.198367:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435b64700 x1874258609380736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432479.198377:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609380736:0@lo:400:kworker.0 00000100:00100000:1.0:1787432479.198735:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609380224:12345-0@lo:400:kworker.0 Request processed in 1238us (14271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432479.198742:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787432479.198771:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609380864 00000100:00100000:1.0:1787432479.198776:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609380864 00000100:00100000:1.0:1787432479.198841:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787432479.198848:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609380864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787432479.198861:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432479.198895:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609380864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432479.198909:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787432479.198976:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039b7100 x1874258609380864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432479.198993:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609380864:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787432479.199005:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435b67480 x1874258609380224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432479.199013:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609380224:0@lo:400:kworker.0 00000100:00100000:0.0:1787432479.200984:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609379968:12345-0@lo:400:kworker.0 Request processed in 15981us (16958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432479.201008:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787432479.201084:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609379328 00000100:00100000:0.0:1787432479.201094:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609379328 00000100:00100000:0.0:1787432479.201150:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787432479.201186:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3642:x1874258609379328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432479.201206:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609379968:0@lo:400:kworker.0 00000100:00100000:0.0:1787432479.201240:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3642:x1874258609379328:12345-0@lo:400:kworker.0 Request processed in 80us (17226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432479.201247:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787432479.201288:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609379584 00000100:00100000:0.0:1787432479.201293:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609379584 00000100:00100000:0.0:1787432479.201328:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787432479.201336:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609379584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432479.201386:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609379584:12345-0@lo:400:kworker.0 Request processed in 51us (16937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432479.201394:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787432479.201423:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609379584:0@lo:400:kworker.0 00000100:00080000:0.0:1787432479.201423:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787432479.201431:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787432479.201436:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432479.202695:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609379328:0@lo:400:kworker.0 00000100:00100000:0.0:1787432479.202715:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609379840:0@lo:400:kworker.0 00010000:00080000:0.0:1787432479.202731:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435b64a80 x1874258609380352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432479.202743:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609380352:0@lo:400:kworker.0 00000100:00100000:1.0:1787432479.275941:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432479.275983:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432479.276013:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432479.276063:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588344192 00000100:00100000:0.0:1787432479.276073:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588344192 00000100:00100000:0.0:1787432479.276135:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 85 00000100:00100000:0.0:1787432479.276145:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2400:x1874258588344192:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432479.276244:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2400:x1874258588344192:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 100us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432479.276252:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 85 00000100:00080000:0.0:1787432479.276273:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432479.276292:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588344448 00000100:00100000:0.0:1787432479.276295:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588344448 00000100:00100000:0.0:1787432479.276322:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:0.0:1787432479.276327:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588344448:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432479.276366:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588344448:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 38us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432479.276371:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00080000:0.0:1787432479.276384:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432479.284369:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432479.284405:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432479.284552:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588344064 00000100:00100000:2.0:1787432479.284562:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588344064 00000100:00100000:2.0:1787432479.284749:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 279 00000100:00100000:2.0:1787432479.284763:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+10:2400:x1874258588344064:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432479.284832:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+10:2400:x1874258588344064:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 73us (8818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432479.284846:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 279 00000100:00100000:3.0:1787432479.285913:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588344320 00000100:00100000:3.0:1787432479.285936:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588344320 00000100:00100000:3.0:1787432479.286009:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 86 00000100:00100000:3.0:1787432479.286020:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588344320:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432479.286087:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588344320:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 69us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432479.286095:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 86 00000100:00100000:0.0:1787432479.287434:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588344576 00000100:00100000:0.0:1787432479.287446:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588344576 00000100:00100000:0.0:1787432479.287571:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 26 00000100:00100000:0.0:1787432479.287585:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588344576:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432479.288011:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588344576:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 427us (3602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432479.288021:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 26 00000100:00080000:0.0:1787432479.288060:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787432479.288065:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787432479.952151:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432480.716993:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432480.717015:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609380992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432480.717085:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432480.717144:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609380992 00000100:00100000:0.0:1787432480.717151:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609380992 00000100:00100000:0.0:1787432480.717230:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787432480.717238:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609380992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432480.717269:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432480.717314:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609380992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432480.717321:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787432480.717427:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609380992:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787432480.972647:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787432481.925094:0:10705:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1787432481.996700:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432483.020529:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432483.791399:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609381120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432483.791476:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432483.791649:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609381248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787432483.791692:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432483.792095:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609381248 00000100:00100000:2.0:1787432483.792102:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609381248 00000100:00100000:2.0:1787432483.792184:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787432483.792272:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609381248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787432483.792304:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432483.792353:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609381248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432483.792372:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1787432483.792395:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787432483.792427:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435ba8e00 x1874258609381248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432483.792447:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609381248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432483.792463:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432483.792470:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609381376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432483.792626:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432483.792652:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609381376 00000100:00100000:2.0:1787432483.792656:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609381376 00000100:00100000:2.0:1787432483.792683:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787432483.792690:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609381376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432483.792726:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432483.792864:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609381120 00000100:00100000:3.0:1787432483.792868:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609381120 00000100:00100000:3.0:1787432483.792901:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787432483.792909:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609381120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787432483.792931:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787432483.792970:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609381376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 280us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432483.792977:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787432483.792993:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787432483.800323:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039b4e00 x1874258609381376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432483.800361:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609381376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432483.800856:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609381120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7942us (9375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432483.800868:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787432483.801118:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609381120:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787432484.043766:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432484.301542:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609381504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432484.301631:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432484.302041:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609381888:0@lo:400:kworker.0 00000100:00100000:3.0:1787432484.302085:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432484.302110:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609382400:0@lo:400:kworker.0 00000100:00100000:3.0:1787432484.302138:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432484.302158:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609382912:0@lo:400:kworker.0 00000100:00100000:3.0:1787432484.302211:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432484.302230:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787432484.302236:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609381760:0@lo:400:kworker.0 00000100:00100000:3.0:1787432484.302258:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432484.302275:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609382272:0@lo:400:kworker.0 00000100:00100000:3.0:1787432484.302306:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432484.302324:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609382784:0@lo:400:kworker.0 00000100:00100000:3.0:1787432484.302341:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432484.302591:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609381888 00000100:00100000:3.0:1787432484.302598:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609381888 00000100:00100000:0.0:1787432484.302722:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609382016:0@lo:400:kworker.0 00000100:00100000:0.0:1787432484.302750:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432484.302764:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609382528:0@lo:400:kworker.0 00000100:00100000:0.0:1787432484.302784:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432484.302800:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609383040:0@lo:400:kworker.0 00000100:00100000:0.0:1787432484.302821:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432484.302853:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787432484.302859:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609381632:0@lo:400:kworker.0 00000100:00100000:0.0:1787432484.302886:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432484.303159:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787432484.303187:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609381888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432484.303256:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609381888:12345-0@lo:400:kworker.0 Request processed in 73us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432484.303264:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787432484.303470:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609382144:0@lo:400:kworker.0 00000100:00100000:0.0:1787432484.303497:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432484.303515:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609382656:0@lo:400:kworker.0 00000100:00100000:0.0:1787432484.303711:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432484.303744:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609382528 00000100:00100000:0.0:1787432484.303748:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609382528 00000100:00100000:0.0:1787432484.303778:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609383040 00000100:00100000:0.0:1787432484.303781:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609383040 00000100:00100000:0.0:1787432484.303801:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609382656 00000100:00100000:0.0:1787432484.303804:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609382656 00000100:00100000:0.0:1787432484.303816:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787432484.303837:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609382528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432484.303877:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609382528:12345-0@lo:400:kworker.0 Request processed in 53us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432484.303883:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787432484.304688:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609383168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432484.304735:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432484.304781:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609381504 00000100:00100000:2.0:1787432484.304798:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609381504 00000100:00100000:2.0:1787432484.304845:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609383168 00000100:00100000:2.0:1787432484.304848:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609383168 00000100:00100000:2.0:1787432484.304863:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787432484.304870:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609381504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787432484.304893:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432484.305051:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609381504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 181us (3420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432484.305058:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787432484.305076:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787432484.305083:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874258609383168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432484.305093:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432484.305122:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874258609383168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432484.305129:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1787432484.305151:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787432484.305207:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039b4e00 x1874258609383168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432484.305229:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609383168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432484.306554:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609382400 00000100:00100000:3.0:1787432484.306633:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609382400 00000100:00100000:3.0:1787432484.306726:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609382912 00000100:00100000:3.0:1787432484.306730:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609382912 00000100:00100000:3.0:1787432484.306748:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609381760 00000100:00100000:3.0:1787432484.306752:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609381760 00000100:00100000:3.0:1787432484.306764:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609382272 00000100:00100000:3.0:1787432484.306767:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609382272 00000100:00100000:3.0:1787432484.306779:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609382784 00000100:00100000:3.0:1787432484.306782:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609382784 00000100:00100000:3.0:1787432484.306793:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609382016 00000100:00100000:3.0:1787432484.306795:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609382016 00000100:00100000:3.0:1787432484.306811:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787432484.306821:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609382400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432484.307037:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609382400:12345-0@lo:400:kworker.0 Request processed in 216us (4897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432484.307045:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787432484.307063:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787432484.307071:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609382912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432484.307105:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609382912:12345-0@lo:400:kworker.0 Request processed in 35us (4893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432484.307111:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787432484.307123:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787432484.307129:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609381760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432484.307158:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609381760:12345-0@lo:400:kworker.0 Request processed in 30us (4900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432484.307213:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787432484.307226:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787432484.307232:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609382272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432484.307265:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609382272:12345-0@lo:400:kworker.0 Request processed in 34us (4958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432484.307270:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787432484.307282:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787432484.307289:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609382784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432484.307317:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609382784:12345-0@lo:400:kworker.0 Request processed in 29us (4975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432484.307323:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787432484.307333:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787432484.307340:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609382016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432484.307369:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609382016:12345-0@lo:400:kworker.0 Request processed in 30us (4618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432484.307375:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1787432484.307415:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787432484.307421:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787432484.307450:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609382144 00000100:00100000:3.0:1787432484.307456:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609382144 00000100:00100000:3.0:1787432484.307494:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787432484.307501:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609382144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432484.307538:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609382144:12345-0@lo:400:kworker.0 Request processed in 38us (4040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432484.307544:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787432484.307815:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609381760:0@lo:400:kworker.0 00000100:00100000:3.0:1787432484.307841:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609382272:0@lo:400:kworker.0 00000100:00100000:3.0:1787432484.307863:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609382784:0@lo:400:kworker.0 00000100:00100000:3.0:1787432484.307877:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609381888:0@lo:400:kworker.0 00010000:00080000:3.0:1787432484.307892:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039a9500 x1874258609382400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432484.307975:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609382400:0@lo:400:kworker.0 00010000:00080000:3.0:1787432484.307990:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039ab480 x1874258609382912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432484.307998:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609382912:0@lo:400:kworker.0 00000100:00100000:2.0:1787432484.308262:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787432484.308281:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609383040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432484.308347:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609383040:12345-0@lo:400:kworker.0 Request processed in 74us (5524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432484.308354:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787432484.308394:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787432484.308402:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609382656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432484.308436:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609382656:12345-0@lo:400:kworker.0 Request processed in 37us (4725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432484.308442:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787432484.308464:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609381632 00000100:00100000:2.0:1787432484.308469:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609381632 00000100:00100000:2.0:1787432484.308510:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787432484.308517:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609381632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432484.308562:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609381632:12345-0@lo:400:kworker.0 Request processed in 46us (5675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432484.308570:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787432484.312449:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609381632:0@lo:400:kworker.0 00000100:00100000:0.0:1787432484.312479:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609382144:0@lo:400:kworker.0 00010000:00080000:0.0:1787432484.312499:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039aa680 x1874258609382656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432484.312511:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609382656:0@lo:400:kworker.0 00000100:00100000:0.0:1787432484.313030:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609382016:0@lo:400:kworker.0 00010000:00080000:0.0:1787432484.313101:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039aa300 x1874258609382528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432484.313111:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609382528:0@lo:400:kworker.0 00010000:00080000:0.0:1787432484.313127:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039a8000 x1874258609383040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432484.313135:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609383040:0@lo:400:kworker.0 00010000:00080000:0.0:1787432484.313326:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830390a300 x1874258609381504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432484.314855:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609381504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787432484.380723:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432484.380770:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432484.380869:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588344832 00000100:00100000:1.0:1787432484.380869:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432484.380880:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588344832 00000100:00100000:3.0:1787432484.380954:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588344960 00000100:00100000:3.0:1787432484.380958:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588344960 00000100:00100000:3.0:1787432484.380987:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 93 00000100:00100000:3.0:1787432484.380999:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2400:x1874258588344832:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432484.381040:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 94 00000100:00100000:1.0:1787432484.381048:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588344960:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432484.381083:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588344960:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 37us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432484.381091:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 94 00000100:00100000:0.0:1787432484.381158:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588344704 00000100:00100000:0.0:1787432484.381183:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588344704 00000100:00100000:0.0:1787432484.381216:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 281 00000100:00100000:0.0:1787432484.381224:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:2400:x1874258588344704:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432484.381249:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2400:x1874258588344832:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 252us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432484.381252:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:2400:x1874258588344704:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432484.381257:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 93 00000100:00100000:0.0:1787432484.381258:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 281 00000100:00080000:3.0:1787432484.381279:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432484.381294:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432484.386776:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432484.386843:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432484.386883:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588345088 00000100:00100000:2.0:1787432484.386895:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588345088 00000100:00100000:0.0:1787432484.386941:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588345216 00000100:00100000:0.0:1787432484.386947:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588345216 00000100:00100000:2.0:1787432484.387037:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00100000:2.0:1787432484.387052:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2399:x1874258588345088:12345-192.168.204.24@tcp:9:kworker.0 00000020:00000080:2.0:1787432484.387095:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563eb6c 00000100:00080000:2.0:1787432484.387108:0:8431:0:(import.c:65:import_set_state_nolock()) ffff948303553800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787432484.387152:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787432484.387345:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+2:2399:x1874258588345088:12345-192.168.204.24@tcp:9:kworker.0 Request processed in 296us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432484.387355:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00080000:3.0:1787432484.387847:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432484.387853:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787432484.387882:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432484.391188:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 19 00000100:00100000:0.0:1787432484.391210:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2399:x1874258588345216:12345-192.168.204.24@tcp:9:kworker.0 00000020:00000080:0.0:1787432484.391263:0:8806:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563eb73 00000100:00080000:0.0:1787432484.391276:0:8806:0:(import.c:65:import_set_state_nolock()) ffff948303551000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787432484.391339:0:8806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787432484.391772:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+2:2399:x1874258588345216:12345-192.168.204.24@tcp:9:kworker.0 Request processed in 567us (4926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432484.391782:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 19 00010000:00010000:0.0:1787432484.391871:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432485.068786:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432485.835360:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432485.835385:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609383296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432485.835463:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432485.835553:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609383296 00000100:00100000:0.0:1787432485.835570:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609383296 00000100:00100000:0.0:1787432485.835615:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787432485.835624:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609383296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432485.835960:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432485.836017:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609383296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 393us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432485.836023:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787432485.836076:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609383296:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787432486.091802:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432487.126250:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432488.146278:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787432488.180929:0:10949:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing yml_node 00000100:00100000:2.0:1787432488.907473:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609383424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432488.907581:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432488.907689:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432488.907700:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609383552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432488.907806:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432488.907861:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609383424 00000100:00100000:2.0:1787432488.907872:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609383424 00000100:00100000:2.0:1787432488.907934:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787432488.907946:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609383424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787432488.907996:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787432488.908057:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609383424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432488.908065:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787432488.908092:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609383552 00000100:00100000:2.0:1787432488.908095:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609383552 00000100:00100000:2.0:1787432488.908138:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787432488.908145:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609383552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787432488.908199:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432488.908239:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609383552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432488.908246:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1787432488.908289:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039b7100 x1874258609383552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432488.908312:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609383552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432488.908347:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609383424:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1787432488.908380:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432488.908726:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432488.908747:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609383680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432488.908781:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432488.909345:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609383680 00000100:00100000:2.0:1787432488.909352:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609383680 00000100:00100000:2.0:1787432488.909418:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787432488.909425:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609383680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432488.909439:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432488.909481:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609383680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432488.909489:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1787432488.909524:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830390a300 x1874258609383680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432488.909540:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609383680:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787432488.909612:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787432489.171892:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432489.422873:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609383808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432489.422952:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432489.423267:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432489.423279:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609383936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432489.423308:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432489.423358:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609383808 00000100:00100000:2.0:1787432489.423367:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609383808 00000100:00100000:2.0:1787432489.423431:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609383936 00000100:00100000:2.0:1787432489.423434:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609383936 00000100:00100000:2.0:1787432489.423454:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787432489.423471:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609383808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432489.423504:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432489.423557:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609383808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432489.423565:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787432489.423583:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787432489.423590:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609383936:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787432489.424044:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609384064:0@lo:400:kworker.0 00000100:00100000:1.0:1787432489.424101:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432489.424131:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609384576:0@lo:400:kworker.0 00000100:00100000:1.0:1787432489.424161:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432489.424212:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609385088:0@lo:400:kworker.0 00000100:00100000:1.0:1787432489.424239:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432489.424444:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787432489.424451:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609384192:0@lo:400:kworker.0 00000100:00100000:1.0:1787432489.424486:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432489.424508:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609384704:0@lo:400:kworker.0 00000100:00100000:1.0:1787432489.424531:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432489.424548:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609385216:0@lo:400:kworker.0 00000100:00100000:1.0:1787432489.424567:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432489.424605:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609384192 00000100:00100000:1.0:1787432489.424611:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609384192 00000100:00100000:1.0:1787432489.424649:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609384704 00000100:00100000:1.0:1787432489.424652:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609384704 00000100:00100000:1.0:1787432489.424673:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609385216 00000100:00100000:1.0:1787432489.424675:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609385216 00000100:00100000:1.0:1787432489.424690:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787432489.424696:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609384192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432489.424821:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609384192:12345-0@lo:400:kworker.0 Request processed in 124us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432489.424829:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787432489.424845:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00002000:00000024:2.0:1787432489.424851:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432489.424852:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609384704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432489.424880:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609384704:12345-0@lo:400:kworker.0 Request processed in 30us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432489.424886:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787432489.424889:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609383936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1301us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432489.424896:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787432489.424896:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787432489.424902:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609385216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432489.424922:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609384064 00000100:00100000:2.0:1787432489.424926:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609384064 00000100:00100000:1.0:1787432489.424926:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609385216:12345-0@lo:400:kworker.0 Request processed in 25us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432489.424942:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787432489.424950:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787432489.424957:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609384064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432489.424973:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609384448:0@lo:400:kworker.0 00000100:00100000:2.0:1787432489.424986:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609384064:12345-0@lo:400:kworker.0 Request processed in 30us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432489.424995:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432489.425012:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609384960:0@lo:400:kworker.0 00000100:00100000:1.0:1787432489.425032:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432489.425050:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787432489.425056:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609384320:0@lo:400:kworker.0 00000100:00100000:2.0:1787432489.425069:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787432489.425078:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432489.425097:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609384832:0@lo:400:kworker.0 00000100:00100000:2.0:1787432489.425100:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609385088 00000100:00100000:2.0:1787432489.425104:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609385088 00000100:00100000:1.0:1787432489.425116:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432489.425125:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609384960 00000100:00100000:2.0:1787432489.425127:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609384960 00000100:00100000:1.0:1787432489.425129:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609385344:0@lo:400:kworker.0 00000100:00100000:1.0:1787432489.425145:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432489.425146:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787432489.425152:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609385088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432489.425183:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787432489.425191:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609384960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432489.425197:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609385088:12345-0@lo:400:kworker.0 Request processed in 46us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432489.425203:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787432489.425221:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609384960:12345-0@lo:400:kworker.0 Request processed in 31us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432489.425228:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787432489.425245:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609384576 00000100:00100000:1.0:1787432489.425248:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609384576 00010000:00080000:2.0:1787432489.425249:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303908000 x1874258609383936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432489.425271:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609383936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787432489.425271:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609384320 00000100:00100000:1.0:1787432489.425273:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609384320 00010000:00080000:2.0:1787432489.425285:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039b4e00 x1874258609383808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432489.425297:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609383808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432489.425300:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787432489.425306:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609384576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432489.426263:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787432489.426275:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609384320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432489.426331:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609384320:12345-0@lo:400:kworker.0 Request processed in 60us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432489.426338:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787432489.426364:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609384448 00000100:00100000:2.0:1787432489.426369:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609384448 00000100:00100000:2.0:1787432489.426397:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609384832 00000100:00100000:2.0:1787432489.426400:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609384832 00000100:00100000:2.0:1787432489.426420:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609385344 00000100:00100000:2.0:1787432489.426423:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609385344 00000100:00100000:2.0:1787432489.426438:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787432489.426444:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609384448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432489.426475:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609384448:12345-0@lo:400:kworker.0 Request processed in 30us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432489.426481:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787432489.426491:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787432489.426497:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609384832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432489.426928:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609384576:12345-0@lo:400:kworker.0 Request processed in 1621us (2765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432489.426944:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787432489.426968:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787432489.426976:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609385344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432489.427007:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609385344:12345-0@lo:400:kworker.0 Request processed in 33us (1860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432489.427013:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1787432489.427863:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432489.427875:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432489.427879:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432489.428061:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609384832:12345-0@lo:400:kworker.0 Request processed in 1559us (2938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432489.428072:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787432489.428146:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609384320:0@lo:400:kworker.0 00010000:00080000:2.0:1787432489.428180:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f85ad80 x1874258609384832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432489.428192:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609384832:0@lo:400:kworker.0 00010000:00080000:2.0:1787432489.428221:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303916680 x1874258609385344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432489.428230:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609385344:0@lo:400:kworker.0 00000100:00100000:2.0:1787432489.428243:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609384448:0@lo:400:kworker.0 00010000:00080000:2.0:1787432489.428258:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f858e00 x1874258609384960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432489.428267:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609384960:0@lo:400:kworker.0 00000100:00100000:2.0:1787432489.428321:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609384192:0@lo:400:kworker.0 00000100:00100000:2.0:1787432489.428339:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609384704:0@lo:400:kworker.0 00000100:00100000:2.0:1787432489.428358:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609385216:0@lo:400:kworker.0 00000100:00100000:2.0:1787432489.428370:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609384064:0@lo:400:kworker.0 00000100:00100000:2.0:1787432489.428383:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609384576:0@lo:400:kworker.0 00010000:00080000:2.0:1787432489.428396:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f85b480 x1874258609385088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432489.428405:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609385088:0@lo:400:kworker.0 00000100:00100000:3.0:1787432489.496998:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432489.497062:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432489.497109:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432489.497351:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588345344 00000100:00100000:0.0:1787432489.497364:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588345344 00000100:00100000:0.0:1787432489.497430:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 283 00000100:00100000:0.0:1787432489.497441:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:2400:x1874258588345344:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432489.497522:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:2400:x1874258588345344:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 83us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432489.497530:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 283 00000100:00100000:2.0:1787432489.497886:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588345472 00000100:00100000:2.0:1787432489.497893:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588345472 00000100:00100000:2.0:1787432489.497957:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588345600 00000100:00100000:2.0:1787432489.497961:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588345600 00000100:00100000:2.0:1787432489.497989:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 101 00000100:00100000:2.0:1787432489.498008:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2400:x1874258588345472:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432489.498017:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 102 00000100:00100000:1.0:1787432489.498025:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588345600:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432489.498067:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2400:x1874258588345472:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 61us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432489.498076:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 101 00000100:00080000:0.0:1787432489.498146:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787432489.498152:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432489.503716:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588345600:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 5674us (6588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432489.503803:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 102 00000001:00100000:0.0:1787432489.934521:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000020:00000080:0.0:1787432489.934543:0:9509:0:(genops.c:885:class_export_put()) final put ffff948303553000/e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000020:00000080:1.0:1787432489.935885:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff948303553000/e37f63ac-9665-4d30-ad26-0faad6e6c7da for lustre-OST0001 00000020:00000080:1.0:1787432489.935967:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948303551000 for lustre-OST0001 00000001:00100000:2.0:1787432489.936765:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000020:00000080:2.0:1787432489.936773:0:8425:0:(genops.c:885:class_export_put()) final put ffff948303554800/e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000020:00000080:1.0:1787432489.936901:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff948303554800/e37f63ac-9665-4d30-ad26-0faad6e6c7da for lustre-OST0000 00000020:00000080:1.0:1787432489.937266:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948303553800 for lustre-OST0000 00010000:00010000:0.0:1787432490.187477:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432490.955708:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432490.955747:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609385472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432490.955824:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432490.956236:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609385472 00000100:00100000:0.0:1787432490.956245:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609385472 00000100:00100000:0.0:1787432490.956313:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787432490.956323:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609385472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432490.956356:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432490.956412:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609385472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432490.956600:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787432490.956774:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609385472:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787432491.218559:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432492.235522:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432493.268542:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787432493.830884:0:11132:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.63 00000100:00100000:2.0:1787432494.029389:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609385600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432494.029523:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432494.029594:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432494.029601:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609385728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432494.029650:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432494.029693:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432494.029715:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609385856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432494.029741:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432494.029774:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609385600 00000100:00100000:2.0:1787432494.029783:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609385600 00000100:00100000:2.0:1787432494.029846:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609385856 00000100:00100000:2.0:1787432494.029849:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609385856 00000100:00100000:2.0:1787432494.029869:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787432494.029879:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609385600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432494.029936:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432494.029982:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609385600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432494.029990:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787432494.030021:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787432494.030028:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609385856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787432494.030045:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432494.030074:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609385856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432494.030079:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787432494.030118:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f858700 x1874258609385856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432494.030141:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609385856:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1787432494.030199:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039b4e00 x1874258609385600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432494.030210:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609385600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432494.030619:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609385728 00000100:00100000:0.0:1787432494.030626:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609385728 00000100:00100000:0.0:1787432494.030774:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787432494.030784:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609385728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432494.030813:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787432494.032152:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609385728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1355us (2485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432494.032180:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1787432494.032228:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432494.039789:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609385728:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787432494.284429:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432494.541780:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609385984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432494.542035:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432494.542140:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432494.542150:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609386112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432494.542203:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432494.542315:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609385984 00000100:00100000:2.0:1787432494.542334:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609385984 00000100:00100000:2.0:1787432494.542404:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609386112 00000100:00100000:2.0:1787432494.542408:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609386112 00000100:00100000:2.0:1787432494.542426:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787432494.542436:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f85ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609385984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432494.542661:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432494.542729:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f85ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609385984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 294us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432494.542739:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787432494.542783:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787432494.542790:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609386112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787432494.542802:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432494.542832:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609386112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432494.542838:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1787432494.542855:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787432494.543232:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f858700 x1874258609385984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432494.543270:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609385984:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787432494.543968:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303909c00 x1874258609386112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432494.543984:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609386112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787432494.551411:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609386624:0@lo:400:kworker.0 00000100:00100000:1.0:1787432494.551656:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432494.551702:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609387136:0@lo:400:kworker.0 00000100:00100000:1.0:1787432494.551732:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432494.551763:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787432494.551769:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609386240:0@lo:400:kworker.0 00000100:00100000:1.0:1787432494.551799:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432494.551830:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609386752:0@lo:400:kworker.0 00000100:00100000:1.0:1787432494.551872:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432494.551910:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609386240 00000100:00100000:1.0:1787432494.551919:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609386240 00000100:00100000:1.0:1787432494.551981:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787432494.551991:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609386240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432494.552046:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609386240:12345-0@lo:400:kworker.0 Request processed in 55us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432494.552053:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787432494.552132:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609387136 00000100:00100000:1.0:1787432494.552136:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609387136 00000100:00100000:1.0:1787432494.552197:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609386752 00000100:00100000:1.0:1787432494.552200:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609386752 00000100:00100000:1.0:1787432494.552220:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787432494.552227:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609387136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432494.552270:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609387136:12345-0@lo:400:kworker.0 Request processed in 44us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432494.552276:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787432494.552286:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787432494.552292:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609386752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432494.552316:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609386752:12345-0@lo:400:kworker.0 Request processed in 25us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432494.552444:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1787432494.552463:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432494.552468:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432494.552640:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609386240:0@lo:400:kworker.0 00000100:00100000:1.0:1787432494.552659:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609386752:0@lo:400:kworker.0 00010000:00080000:1.0:1787432494.552687:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303916680 x1874258609387136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432494.552698:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609387136:0@lo:400:kworker.0 00000100:00100000:2.0:1787432494.556306:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609386368:0@lo:400:kworker.0 00000100:00100000:2.0:1787432494.556403:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432494.556460:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609386880:0@lo:400:kworker.0 00000100:00100000:2.0:1787432494.556484:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432494.556526:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787432494.556534:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609386496:0@lo:400:kworker.0 00000100:00100000:2.0:1787432494.556559:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432494.556579:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609387008:0@lo:400:kworker.0 00000100:00100000:2.0:1787432494.556599:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432494.556645:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609386368 00000100:00100000:2.0:1787432494.556654:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609386368 00000100:00100000:2.0:1787432494.556836:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609386880 00000100:00100000:2.0:1787432494.556839:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609386880 00000100:00100000:2.0:1787432494.556884:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609386496 00000100:00100000:2.0:1787432494.556887:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609386496 00000100:00100000:2.0:1787432494.556906:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609387008 00000100:00100000:2.0:1787432494.556909:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609387008 00000100:00100000:2.0:1787432494.556951:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787432494.556962:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609386368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432494.557025:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609386368:12345-0@lo:400:kworker.0 Request processed in 64us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432494.557034:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787432494.557053:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787432494.557060:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609386880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432494.557099:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609386880:12345-0@lo:400:kworker.0 Request processed in 40us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432494.557105:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787432494.557118:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787432494.557126:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609386496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432494.557151:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609386496:12345-0@lo:400:kworker.0 Request processed in 27us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432494.557157:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787432494.557191:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787432494.557197:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609387008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432494.557224:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609387008:12345-0@lo:400:kworker.0 Request processed in 27us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432494.557230:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787432494.557283:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609386496:0@lo:400:kworker.0 00000100:00100000:2.0:1787432494.557294:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609387008:0@lo:400:kworker.0 00000100:00100000:2.0:1787432494.557305:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609386368:0@lo:400:kworker.0 00010000:00080000:2.0:1787432494.557319:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303915500 x1874258609386880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432494.557338:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609386880:0@lo:400:kworker.0 00000100:00080000:2.0:1787432494.557377:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787432494.557384:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787432494.559614:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609386624 00000100:00100000:0.0:1787432494.559966:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609386624 00000100:00100000:0.0:1787432494.560676:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787432494.560690:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609386624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432494.560822:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609386624:12345-0@lo:400:kworker.0 Request processed in 135us (9166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432494.560830:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787432494.562863:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609386624:0@lo:400:kworker.0 00000100:00100000:2.0:1787432494.615134:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432494.615224:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432494.615269:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432494.615301:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588345856 00000100:00100000:2.0:1787432494.615314:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588345856 00000100:00100000:2.0:1787432494.615397:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588345984 00000100:00100000:2.0:1787432494.615401:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588345984 00000100:00100000:2.0:1787432494.615424:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 109 00000100:00100000:2.0:1787432494.615435:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588345856:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432494.615654:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588345856:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 220us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432494.615662:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 109 00000100:00100000:2.0:1787432494.615680:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 110 00000100:00100000:2.0:1787432494.615688:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588345984:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432494.615716:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588345984:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432494.615723:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 110 00000100:00080000:2.0:1787432494.615740:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787432494.615744:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432494.623355:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588345728 00000100:00100000:1.0:1787432494.623381:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588345728 00000100:00100000:1.0:1787432494.623479:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 285 00000100:00100000:1.0:1787432494.623491:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:2403:x1874258588345728:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432494.623594:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:2403:x1874258588345728:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 105us (8369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432494.623602:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 285 00010000:00010000:0.0:1787432495.310838:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432496.079924:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609387264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432496.080011:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432496.080923:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609387264 00000100:00100000:0.0:1787432496.080934:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609387264 00000100:00100000:0.0:1787432496.081000:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787432496.081012:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609387264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432496.081052:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432496.081131:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609387264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432496.081138:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787432496.081324:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609387264:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787432496.336250:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787432497.018119:0:11230:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.63 00010000:00010000:2.0:1787432497.359809:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432498.379394:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432499.147618:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609387392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432499.147781:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432499.147972:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432499.147980:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609387520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787432499.148005:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432499.148180:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609387648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432499.148220:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432499.148249:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609387392 00000100:00100000:2.0:1787432499.148256:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609387392 00000100:00100000:2.0:1787432499.148303:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609387520 00000100:00100000:2.0:1787432499.148305:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609387520 00000100:00100000:2.0:1787432499.148320:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787432499.148327:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609387392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432499.148357:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432499.148389:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609387392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432499.148396:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787432499.148410:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787432499.148427:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609387520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787432499.148435:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432499.148454:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609387520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 28us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432499.148459:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1787432499.148472:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787432499.148630:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039ab100 x1874258609387520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432499.148652:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609387520:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787432499.148665:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830390a680 x1874258609387392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432499.148675:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609387392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432499.148914:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609387648 00000100:00100000:0.0:1787432499.148920:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609387648 00000100:00100000:0.0:1787432499.148956:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787432499.148962:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609387648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432499.148988:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787432499.149144:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609387648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432499.149152:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787432499.150257:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609387648:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787432499.403378:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432499.659501:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609388032:0@lo:400:kworker.0 00000100:00100000:1.0:1787432499.659604:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432499.659669:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609388544:0@lo:400:kworker.0 00000100:00100000:1.0:1787432499.659692:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432499.659723:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787432499.659728:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609387904:0@lo:400:kworker.0 00000100:00100000:1.0:1787432499.659749:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432499.659765:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609388416:0@lo:400:kworker.0 00000100:00100000:1.0:1787432499.659786:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432499.659802:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609388928:0@lo:400:kworker.0 00000100:00100000:1.0:1787432499.659834:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432499.660342:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609388032 00000100:00100000:3.0:1787432499.660354:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609388032 00000100:00100000:3.0:1787432499.660413:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609388544 00000100:00100000:3.0:1787432499.660416:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609388544 00000100:00100000:3.0:1787432499.660449:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609387904 00000100:00100000:3.0:1787432499.660451:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609387904 00000100:00100000:3.0:1787432499.660460:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609388416 00000100:00100000:3.0:1787432499.660462:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609388416 00000100:00100000:3.0:1787432499.660477:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787432499.660485:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609388032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.660561:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609388032:12345-0@lo:400:kworker.0 Request processed in 76us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432499.660569:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787432499.660589:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787432499.660596:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609388544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.660623:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609388544:12345-0@lo:400:kworker.0 Request processed in 28us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432499.660629:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787432499.660641:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787432499.660647:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609387904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.660672:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609387904:12345-0@lo:400:kworker.0 Request processed in 26us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432499.660677:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787432499.660688:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787432499.660694:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609388416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.660720:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609388416:12345-0@lo:400:kworker.0 Request processed in 27us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432499.660726:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787432499.660750:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609388160:0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.660780:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432499.660811:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609388672:0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.660834:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432499.660851:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787432499.660856:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609387776:0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.660881:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432499.660903:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609388288:0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.660923:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432499.660939:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609388800:0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.660959:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432499.660987:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609388160 00000100:00100000:3.0:1787432499.660991:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609388160 00000100:00100000:3.0:1787432499.661018:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787432499.661040:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609388160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.661079:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609388160:12345-0@lo:400:kworker.0 Request processed in 41us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432499.661086:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787432499.661105:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609387776 00000100:00100000:3.0:1787432499.661108:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609387776 00000100:00100000:3.0:1787432499.661127:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787432499.661133:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609387776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.661215:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609387776:12345-0@lo:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432499.661223:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787432499.661253:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609388928 00000100:00100000:3.0:1787432499.661256:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609388928 00000100:00100000:3.0:1787432499.661280:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609388800 00000100:00100000:3.0:1787432499.661283:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609388800 00000100:00100000:3.0:1787432499.661312:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787432499.661318:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843cb9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609388928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.661348:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843cb9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609388928:12345-0@lo:400:kworker.0 Request processed in 31us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432499.661354:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787432499.661503:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787432499.661509:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609388800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.661546:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609388800:12345-0@lo:400:kworker.0 Request processed in 38us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432499.661551:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787432499.661567:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609388672 00000100:00100000:3.0:1787432499.661570:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609388672 00000100:00100000:3.0:1787432499.661584:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609388288 00000100:00100000:3.0:1787432499.661587:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609388288 00000100:00100000:3.0:1787432499.661597:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787432499.661602:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609388672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.661627:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609388672:12345-0@lo:400:kworker.0 Request processed in 24us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432499.661632:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787432499.661641:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787432499.661646:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609388288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.661667:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609388288:12345-0@lo:400:kworker.0 Request processed in 21us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432499.661672:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787432499.661719:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609387904:0@lo:400:kworker.0 00010000:00080000:3.0:1787432499.661733:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f920700 x1874258609388416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432499.661749:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609388416:0@lo:400:kworker.0 00010000:00080000:3.0:1787432499.661761:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f922300 x1874258609388928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432499.661771:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609388928:0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.661783:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609388032:0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.661793:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609388544:0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.661832:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609387776:0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.661842:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609388288:0@lo:400:kworker.0 00010000:00080000:3.0:1787432499.661851:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f921500 x1874258609388800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432499.661860:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609388800:0@lo:400:kworker.0 00000100:00100000:3.0:1787432499.661870:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609388160:0@lo:400:kworker.0 00010000:00080000:3.0:1787432499.661879:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f921180 x1874258609388672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432499.661886:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609388672:0@lo:400:kworker.0 00000100:00080000:2.0:1787432499.663213:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787432499.663223:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787432499.663226:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432499.663457:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609389056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432499.663519:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432499.663645:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609389184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432499.663674:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432499.663710:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609389056 00000100:00100000:0.0:1787432499.663716:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609389056 00000100:00100000:0.0:1787432499.663757:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609389184 00000100:00100000:0.0:1787432499.663774:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609389184 00000100:00100000:0.0:1787432499.663793:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787432499.663802:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609389056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787432499.663829:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432499.667368:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609389056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3554us (3836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432499.667386:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787432499.667429:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787432499.667449:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609389184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787432499.667474:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432499.667572:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609389184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (3888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432499.667578:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787432499.675986:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303909500 x1874258609389184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432499.676034:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609389184:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787432499.684700:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039ab480 x1874258609389056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432499.684742:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609389056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432499.738742:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432499.738839:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432499.738881:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432499.738938:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588346240 00000100:00100000:3.0:1787432499.738951:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588346240 00000100:00100000:3.0:1787432499.739044:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588346368 00000100:00100000:3.0:1787432499.739048:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588346368 00000100:00100000:3.0:1787432499.739075:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 117 00000100:00100000:3.0:1787432499.739086:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2401:x1874258588346240:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432499.739209:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588346112 00000100:00100000:1.0:1787432499.739215:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588346112 00000100:00100000:1.0:1787432499.739251:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 287 00000100:00100000:1.0:1787432499.739260:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+10:2401:x1874258588346112:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432499.739289:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+10:2401:x1874258588346112:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432499.739295:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 287 00000100:00100000:3.0:1787432499.739356:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2401:x1874258588346240:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 138us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432499.739365:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 117 00000100:00100000:3.0:1787432499.739387:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 118 00000100:00100000:3.0:1787432499.739396:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588346368:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432499.739426:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588346368:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 32us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432499.739432:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 118 00000100:00080000:2.0:1787432499.740334:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787432499.740340:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787432500.427568:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787432500.779020:0:11327:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.63 00000100:00100000:2.0:1787432501.195543:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609389312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787432501.195649:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432501.198485:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609389312 00000100:00100000:1.0:1787432501.198518:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609389312 00000100:00100000:1.0:1787432501.199101:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787432501.199119:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609389312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787432501.199288:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787432501.199428:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609389312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 315us (3778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432501.199436:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787432501.199896:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609389312:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787432501.451443:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432502.476318:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787432502.904562:0:11376:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Aug 22 17:01:40 EDT 2026 00010000:00010000:1.0:1787432503.500721:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432504.268894:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609389440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432504.269005:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432504.269156:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609389440 00000100:00100000:0.0:1787432504.269198:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609389440 00000100:00100000:0.0:1787432504.269270:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787432504.269283:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609389440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432504.269349:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787432504.269455:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609389440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 174us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432504.269463:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787432504.269520:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609389440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432504.269756:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432504.269775:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432504.269780:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609389568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432504.269783:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609389696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432504.269839:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432504.269892:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432504.270149:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609389568 00000100:00100000:0.0:1787432504.270155:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609389568 00000100:00100000:0.0:1787432504.270223:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609389696 00000100:00100000:0.0:1787432504.270226:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609389696 00000100:00100000:0.0:1787432504.270244:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787432504.270253:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609389568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787432504.270276:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432504.270456:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609389568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 203us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432504.270463:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787432504.270477:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787432504.270483:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609389696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432504.270492:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432504.270520:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609389696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432504.270525:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1787432504.270563:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303908e00 x1874258609389696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432504.270578:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609389696:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787432504.271812:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f921500 x1874258609389568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432504.271837:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609389568:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787432504.272222:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787432504.524890:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432504.780533:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609389824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787432504.780613:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432504.780699:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609389824 00000100:00100000:1.0:1787432504.780708:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609389824 00000100:00100000:1.0:1787432504.780765:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787432504.780775:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609389824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787432504.780804:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432504.780848:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609389824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432504.780856:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787432504.780879:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787432504.780921:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f921500 x1874258609389824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432504.780943:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609389824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432504.781297:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609390080:0@lo:400:kworker.0 00000100:00100000:0.0:1787432504.781357:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432504.781385:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609390592:0@lo:400:kworker.0 00000100:00100000:0.0:1787432504.781408:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432504.781440:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787432504.781455:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609389952:0@lo:400:kworker.0 00000100:00100000:0.0:1787432504.781487:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432504.781509:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609390464:0@lo:400:kworker.0 00000100:00100000:0.0:1787432504.781529:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432504.781547:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609390976:0@lo:400:kworker.0 00000100:00100000:0.0:1787432504.781571:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432504.781605:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609390080 00000100:00100000:0.0:1787432504.781609:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609390080 00000100:00100000:0.0:1787432504.781648:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609390592 00000100:00100000:0.0:1787432504.781651:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609390592 00000100:00100000:0.0:1787432504.781675:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609390464 00000100:00100000:0.0:1787432504.781678:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609390464 00000100:00100000:0.0:1787432504.781693:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787432504.781701:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609390080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432504.781747:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609390080:12345-0@lo:400:kworker.0 Request processed in 47us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432504.781754:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787432504.781771:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787432504.781777:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609390592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432504.781803:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609390592:12345-0@lo:400:kworker.0 Request processed in 27us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432504.781809:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787432504.781820:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787432504.781826:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609390464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432504.781852:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609390464:12345-0@lo:400:kworker.0 Request processed in 26us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432504.781868:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787432504.781892:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609390976 00000100:00100000:0.0:1787432504.781897:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609390976 00000100:00100000:0.0:1787432504.781934:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787432504.781940:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609390976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432504.781971:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609390976:12345-0@lo:400:kworker.0 Request processed in 31us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432504.781977:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787432504.782024:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609390464:0@lo:400:kworker.0 00010000:00080000:0.0:1787432504.782035:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303909500 x1874258609390976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432504.782046:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609390976:0@lo:400:kworker.0 00000100:00100000:0.0:1787432504.782055:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609390080:0@lo:400:kworker.0 00010000:00080000:0.0:1787432504.782063:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303908000 x1874258609390592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432504.782070:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609390592:0@lo:400:kworker.0 00000100:00100000:1.0:1787432504.785096:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432504.785137:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609391104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432504.785235:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432504.785283:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609390208:0@lo:400:kworker.0 00000100:00100000:1.0:1787432504.785309:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432504.785329:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609390720:0@lo:400:kworker.0 00000100:00100000:1.0:1787432504.785358:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432504.785377:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787432504.785383:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609390336:0@lo:400:kworker.0 00000100:00100000:1.0:1787432504.785410:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432504.785439:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609390848:0@lo:400:kworker.0 00000100:00100000:1.0:1787432504.785461:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432504.785496:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609389952 00000100:00100000:1.0:1787432504.785503:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609389952 00000100:00100000:1.0:1787432504.785557:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787432504.785567:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3642:x1874258609389952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432504.785627:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3642:x1874258609389952:12345-0@lo:400:kworker.0 Request processed in 60us (4136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432504.785635:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:1.0:1787432504.785669:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432504.785675:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432504.785678:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432504.785688:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609391104 00000100:00100000:1.0:1787432504.785692:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609391104 00000100:00100000:1.0:1787432504.785718:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787432504.785726:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609391104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787432504.785743:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432504.785780:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609391104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432504.785787:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787432504.785804:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609390336 00000100:00100000:1.0:1787432504.785807:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609390336 00000100:00100000:1.0:1787432504.785832:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787432504.785846:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609390336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432504.785882:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609390336:12345-0@lo:400:kworker.0 Request processed in 37us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432504.785889:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1787432504.785930:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f8cea00 x1874258609391104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432504.785948:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609391104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432504.785978:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609390336:0@lo:400:kworker.0 00000100:00100000:1.0:1787432504.786030:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609390208 00000100:00100000:1.0:1787432504.786033:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609390208 00000100:00100000:1.0:1787432504.786467:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609390720 00000100:00100000:1.0:1787432504.786472:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609390720 00000100:00100000:1.0:1787432504.786496:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609390848 00000100:00100000:1.0:1787432504.786499:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609390848 00000100:00100000:1.0:1787432504.786512:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787432504.786518:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609390208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432504.786563:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609390208:12345-0@lo:400:kworker.0 Request processed in 45us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432504.786570:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787432504.786582:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787432504.786588:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609390720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432504.786615:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609390720:12345-0@lo:400:kworker.0 Request processed in 28us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432504.786620:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787432504.786631:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787432504.786637:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609390848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432504.786678:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609390848:12345-0@lo:400:kworker.0 Request processed in 41us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432504.786683:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1787432504.786700:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432504.786704:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787432504.786723:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830390b800 x1874258609390848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432504.786733:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609390848:0@lo:400:kworker.0 00000100:00100000:1.0:1787432504.786745:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609390208:0@lo:400:kworker.0 00000100:00100000:1.0:1787432504.786753:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609390720:0@lo:400:kworker.0 00000100:00100000:3.0:1787432504.789025:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609389952:0@lo:400:kworker.0 00000100:00100000:1.0:1787432504.861403:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432504.861453:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432504.861475:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432504.862096:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588346624 00000100:00100000:1.0:1787432504.862114:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588346624 00000100:00100000:1.0:1787432504.862353:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588346752 00000100:00100000:1.0:1787432504.862357:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588346752 00000100:00100000:1.0:1787432504.862383:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 125 00000100:00100000:1.0:1787432504.862393:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2402:x1874258588346624:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432504.862490:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2402:x1874258588346624:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 98us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432504.862497:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 125 00000100:00100000:1.0:1787432504.862514:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 126 00000100:00100000:1.0:1787432504.862521:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588346752:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432504.863868:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588346752:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1337us (2380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432504.863881:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 126 00000100:00080000:1.0:1787432504.864317:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432504.864327:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432504.865265:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588346496 00000100:00100000:3.0:1787432504.865280:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588346496 00000100:00100000:3.0:1787432504.865369:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 289 00000100:00100000:3.0:1787432504.865383:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+10:2402:x1874258588346496:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432504.865477:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+10:2402:x1874258588346496:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 97us (4022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432504.865484:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 289 00010000:00010000:3.0:1787432505.548872:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432506.315849:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432506.315879:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830391a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609391232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432506.315978:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432506.316131:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609391232 00000100:00100000:0.0:1787432506.316144:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609391232 00000100:00100000:0.0:1787432506.316233:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787432506.316246:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609391232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432506.316291:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432506.316345:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609391232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432506.316353:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787432506.316485:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830391a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609391232:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787432506.573306:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432507.598217:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432508.619720:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432509.387916:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432509.387941:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609391360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432509.388033:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432509.388105:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609391360 00000100:00100000:1.0:1787432509.388113:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609391360 00000100:00100000:1.0:1787432509.388198:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787432509.388210:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609391360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787432509.388247:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432509.388297:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609391360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432509.388305:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1787432509.388348:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787432509.388382:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303915f80 x1874258609391360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432509.388403:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609391360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432509.388709:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830391a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609391488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432509.388780:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432509.390650:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432509.390678:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609391616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432509.390774:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432509.390845:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609391616 00000100:00100000:2.0:1787432509.390854:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609391616 00000100:00100000:2.0:1787432509.390927:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787432509.390940:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609391616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432509.390967:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432509.391012:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609391616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432509.391019:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787432509.391090:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787432509.391121:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303915f80 x1874258609391616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432509.391150:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609391616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432509.391762:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609391488 00000100:00100000:3.0:1787432509.391770:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609391488 00000100:00100000:3.0:1787432509.391823:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787432509.391833:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830391aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609391488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787432509.391867:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787432509.391923:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830391aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609391488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (3143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432509.391931:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787432509.393481:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830391a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609391488:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787432509.647196:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432509.901287:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609391744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432509.901370:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432509.904205:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609392000:0@lo:400:kworker.0 00000100:00100000:3.0:1787432509.904280:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432509.904318:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609392512:0@lo:400:kworker.0 00000100:00100000:2.0:1787432509.905392:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609391744 00000100:00100000:2.0:1787432509.905401:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609391744 00000100:00100000:2.0:1787432509.905489:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787432509.905503:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609391744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787432509.905534:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432509.905603:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609391744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (4232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432509.905610:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787432509.905642:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609392128:0@lo:400:kworker.0 00000100:00100000:2.0:1787432509.905676:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432509.905698:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609392640:0@lo:400:kworker.0 00000100:00100000:0.0:1787432509.905714:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609391872:0@lo:400:kworker.0 00000100:00100000:2.0:1787432509.905717:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432509.905736:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432509.905741:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609393024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432509.905745:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432509.905770:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432509.905773:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609392384:0@lo:400:kworker.0 00000100:00100000:0.0:1787432509.905791:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432509.905813:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609392896:0@lo:400:kworker.0 00000100:00100000:0.0:1787432509.905833:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432509.905852:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787432509.905857:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609392256:0@lo:400:kworker.0 00000100:00100000:0.0:1787432509.905881:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432509.905900:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609392768:0@lo:400:kworker.0 00000100:00100000:0.0:1787432509.905925:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787432509.906035:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039ab480 x1874258609391744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432509.906067:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609391744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432509.917394:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609392000 00000100:00100000:2.0:1787432509.917414:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609392000 00000100:00100000:2.0:1787432509.917497:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609392128 00000100:00100000:2.0:1787432509.917501:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609392128 00000100:00100000:2.0:1787432509.917517:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609392640 00000100:00100000:2.0:1787432509.917519:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609392640 00000100:00100000:0.0:1787432509.917532:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609391872 00000100:00100000:0.0:1787432509.917538:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609391872 00000100:00100000:2.0:1787432509.917540:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609392384 00000100:00100000:2.0:1787432509.917543:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609392384 00000100:00100000:2.0:1787432509.917553:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609392768 00000100:00100000:2.0:1787432509.917555:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609392768 00000100:00100000:0.0:1787432509.917576:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787432509.917587:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3644:x1874258609391872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432509.917680:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3644:x1874258609391872:12345-0@lo:400:kworker.0 Request processed in 96us (11933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432509.917688:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787432509.917726:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787432509.917733:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609392000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432509.917767:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609392000:12345-0@lo:400:kworker.0 Request processed in 35us (13487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432509.917787:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787432509.917800:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787432509.917806:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609392128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432509.917840:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609392128:12345-0@lo:400:kworker.0 Request processed in 35us (12164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432509.917846:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787432509.917856:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787432509.917862:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609392640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432509.917890:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609392640:12345-0@lo:400:kworker.0 Request processed in 28us (12172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432509.917895:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787432509.917906:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787432509.917912:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830391b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609392384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432509.917938:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830391b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609392384:12345-0@lo:400:kworker.0 Request processed in 28us (12147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432509.917944:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787432509.917976:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609392256 00000100:00100000:0.0:1787432509.917981:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609392256 00000100:00100000:0.0:1787432509.918010:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787432509.918016:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830391ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609392256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432509.918319:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830391ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609392256:12345-0@lo:400:kworker.0 Request processed in 302us (12436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432509.918338:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787432509.918384:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432509.918440:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609392000:0@lo:400:kworker.0 00000100:00100000:0.0:1787432509.918476:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609392512 00000100:00100000:0.0:1787432509.918479:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609392512 00000100:00100000:0.0:1787432509.918504:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787432509.918510:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830391b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609392512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432509.918546:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830391b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609392512:12345-0@lo:400:kworker.0 Request processed in 36us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432509.918552:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:0.0:1787432509.918579:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843489f480 x1874258609392512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432509.918589:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609392512:0@lo:400:kworker.0 00000100:00100000:0.0:1787432509.918613:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609392256:0@lo:400:kworker.0 00000100:00100000:0.0:1787432509.918623:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609391872:0@lo:400:kworker.0 00000100:00100000:0.0:1787432509.918634:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609392384:0@lo:400:kworker.0 00000100:00100000:3.0:1787432509.918741:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609393024 00000100:00100000:3.0:1787432509.918746:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609393024 00000100:00100000:3.0:1787432509.918770:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787432509.918783:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609393024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787432509.918797:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432509.918832:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609393024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (13061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432509.918837:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1787432509.918853:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432509.918857:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432509.918860:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432509.919342:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609392896 00000100:00100000:0.0:1787432509.919347:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609392896 00000100:00100000:0.0:1787432509.919378:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787432509.919380:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787432509.919385:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609392896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432509.919387:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609392768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432509.919424:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609392768:12345-0@lo:400:kworker.0 Request processed in 37us (13498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432509.919441:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1787432509.919451:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787432509.922223:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609392896:12345-0@lo:400:kworker.0 Request processed in 2825us (16374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432509.922243:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787432509.922321:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f8ce300 x1874258609393024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432509.922366:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609393024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432509.922406:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609392128:0@lo:400:kworker.0 00010000:00080000:2.0:1787432509.922408:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483038c7480 x1874258609392768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432509.922418:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609392768:0@lo:400:kworker.0 00000100:00100000:0.0:1787432509.922419:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609392640:0@lo:400:kworker.0 00010000:00080000:2.0:1787432509.922431:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483038c5880 x1874258609392896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432509.922449:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609392896:0@lo:400:kworker.0 00000100:00100000:0.0:1787432509.975682:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432509.975734:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432509.975764:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432509.975801:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588347008 00000100:00100000:0.0:1787432509.975812:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588347008 00000100:00100000:0.0:1787432509.975899:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588347136 00000100:00100000:0.0:1787432509.975902:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588347136 00000100:00100000:0.0:1787432509.975935:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 133 00000100:00100000:0.0:1787432509.975949:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2400:x1874258588347008:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432509.976061:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2400:x1874258588347008:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 115us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432509.976070:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 133 00000100:00100000:0.0:1787432509.976093:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 134 00000100:00100000:0.0:1787432509.976100:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588347136:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432509.976127:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588347136:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432509.976134:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 134 00000100:00100000:0.0:1787432509.976155:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588346880 00000100:00100000:0.0:1787432509.976158:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588346880 00000100:00100000:0.0:1787432509.976208:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 291 00000100:00100000:0.0:1787432509.976216:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+10:2400:x1874258588346880:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432509.976241:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+10:2400:x1874258588346880:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432509.976259:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 291 00000100:00080000:0.0:1787432509.976292:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787432509.976296:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787432510.669074:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432511.437263:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432511.437312:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830391bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609393152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432511.437421:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432511.439053:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609393152 00000100:00100000:0.0:1787432511.439079:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609393152 00000100:00100000:0.0:1787432511.441484:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787432511.441518:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609393152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432511.441566:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432511.441670:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609393152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 170us (4250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432511.441678:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787432511.441816:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830391bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609393152:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787432511.691366:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432512.717125:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432513.745705:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432514.507412:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609393280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432514.507510:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432514.507590:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609393408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432514.507616:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432514.507672:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609393280 00000100:00100000:1.0:1787432514.507680:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609393280 00000100:00100000:1.0:1787432514.507740:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609393408 00000100:00100000:1.0:1787432514.507743:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609393408 00000100:00100000:1.0:1787432514.507764:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787432514.507774:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609393280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432514.507814:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432514.507876:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609393280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432514.507883:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787432514.507902:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787432514.507908:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609393408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787432514.507918:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432514.507959:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609393408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432514.507965:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1787432514.508000:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303916300 x1874258609393280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432514.508018:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609393280:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787432514.508029:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435bab100 x1874258609393408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432514.508040:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609393408:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787432514.508965:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432514.509068:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609393536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432514.509131:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432514.509561:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609393536 00000100:00100000:0.0:1787432514.509569:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609393536 00000100:00100000:0.0:1787432514.509627:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787432514.509638:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609393536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432514.509677:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787432514.509745:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609393536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432514.509753:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787432514.509847:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609393536:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787432514.775314:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432515.019385:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432515.019406:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609393664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432515.019486:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432515.019570:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609393664 00000100:00100000:2.0:1787432515.019577:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609393664 00000100:00100000:2.0:1787432515.019630:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787432515.019642:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609393664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432515.019671:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432515.019709:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609393664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432515.019716:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1787432515.019734:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432515.019748:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609393792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432515.019770:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432515.019789:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609393920:0@lo:400:kworker.0 00010000:00080000:2.0:1787432515.019807:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f8ce300 x1874258609393664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432515.019824:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609393664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432515.019848:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609393792 00000100:00100000:2.0:1787432515.019852:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609393792 00000100:00100000:2.0:1787432515.019876:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787432515.019882:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609393792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787432515.019891:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432515.020050:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609394048:0@lo:400:kworker.0 00000100:00100000:3.0:1787432515.020818:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432515.020845:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609393920 00000100:00100000:0.0:1787432515.020850:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609393920 00000100:00100000:3.0:1787432515.020872:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609394432:0@lo:400:kworker.0 00000100:00100000:0.0:1787432515.020881:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787432515.020888:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609393920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432515.020901:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432515.020919:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609394944:0@lo:400:kworker.0 00000100:00100000:0.0:1787432515.020920:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609393920:12345-0@lo:400:kworker.0 Request processed in 34us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432515.020934:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787432515.020941:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432515.020965:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609393920:0@lo:400:kworker.0 00000100:00100000:0.0:1787432515.020966:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609394432 00000100:00100000:0.0:1787432515.020969:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609394432 00000100:00100000:0.0:1787432515.020991:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787432515.020997:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609394432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432515.021042:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609394432:12345-0@lo:400:kworker.0 Request processed in 45us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432515.021049:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787432515.021069:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609394944 00000100:00100000:0.0:1787432515.021073:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609394944 00000100:00100000:0.0:1787432515.021097:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787432515.021103:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609394944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432515.021132:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609394944:12345-0@lo:400:kworker.0 Request processed in 30us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432515.021138:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787432515.021203:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609394432:0@lo:400:kworker.0 00010000:00080000:3.0:1787432515.021214:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303ad8000 x1874258609394944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432515.021234:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609394944:0@lo:400:kworker.0 00000100:00100000:1.0:1787432515.021316:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432515.021375:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609394560:0@lo:400:kworker.0 00000100:00100000:1.0:1787432515.021397:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432515.021462:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303adad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609395072:0@lo:400:kworker.0 00000100:00100000:1.0:1787432515.021484:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432515.021553:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609394048 00000100:00100000:3.0:1787432515.021557:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609394048 00000100:00100000:3.0:1787432515.021594:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609394560 00000100:00100000:3.0:1787432515.021597:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609394560 00000100:00100000:0.0:1787432515.021599:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787432515.021606:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609394048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432515.021631:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787432515.021638:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609394560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432515.021641:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609394048:12345-0@lo:400:kworker.0 Request processed in 36us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432515.021648:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787432515.021668:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609394560:12345-0@lo:400:kworker.0 Request processed in 31us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432515.021674:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787432515.022107:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609394048:0@lo:400:kworker.0 00000100:00100000:1.0:1787432515.022116:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609394560:0@lo:400:kworker.0 00000100:00100000:3.0:1787432515.022186:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609395072 00000100:00100000:3.0:1787432515.022191:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609395072 00000100:00100000:3.0:1787432515.022232:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787432515.022240:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609395072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432515.022277:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609395072:12345-0@lo:400:kworker.0 Request processed in 39us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432515.022284:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787432515.022352:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303adad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609395072:0@lo:400:kworker.0 00000100:00100000:1.0:1787432515.022369:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609394176:0@lo:400:kworker.0 00000100:00100000:1.0:1787432515.022399:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432515.022456:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609394688:0@lo:400:kworker.0 00000100:00100000:1.0:1787432515.022490:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432515.022519:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609395200:0@lo:400:kworker.0 00000100:00100000:1.0:1787432515.022539:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432515.022558:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787432515.022564:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609394304:0@lo:400:kworker.0 00000100:00100000:1.0:1787432515.022585:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432515.022604:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609394816:0@lo:400:kworker.0 00000100:00100000:1.0:1787432515.022657:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432515.022699:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609394688 00000100:00100000:1.0:1787432515.022706:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609394688 00000100:00100000:1.0:1787432515.022747:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609395200 00000100:00100000:1.0:1787432515.022754:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609395200 00000100:00100000:1.0:1787432515.023395:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609394304 00000100:00100000:1.0:1787432515.023405:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609394304 00000100:00100000:1.0:1787432515.023434:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787432515.023441:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609394688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432515.023511:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609394688:12345-0@lo:400:kworker.0 Request processed in 71us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432515.023519:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787432515.023533:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787432515.023540:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609395200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432515.023569:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609395200:12345-0@lo:400:kworker.0 Request processed in 30us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432515.023575:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787432515.023586:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787432515.023591:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609394304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432515.023732:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609394304:12345-0@lo:400:kworker.0 Request processed in 140us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432515.023739:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787432515.023766:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609394816 00000100:00100000:1.0:1787432515.023770:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609394816 00000100:00100000:1.0:1787432515.023863:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787432515.023871:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609394816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432515.023904:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609394816:12345-0@lo:400:kworker.0 Request processed in 34us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432515.023910:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787432515.023949:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609394304:0@lo:400:kworker.0 00010000:00080000:1.0:1787432515.023962:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303adb480 x1874258609394816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432515.023971:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609394816:0@lo:400:kworker.0 00010000:00080000:1.0:1787432515.023980:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303adaa00 x1874258609394688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432515.023987:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609394688:0@lo:400:kworker.0 00010000:00080000:1.0:1787432515.023995:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303ad9c00 x1874258609395200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432515.024003:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609395200:0@lo:400:kworker.0 00000100:00100000:3.0:1787432515.024292:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609394176 00000100:00100000:3.0:1787432515.024297:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609394176 00000100:00100000:1.0:1787432515.024432:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787432515.024440:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433739850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609394176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432515.024486:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433739850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609394176:12345-0@lo:400:kworker.0 Request processed in 45us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432515.024745:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1787432515.025272:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432515.025284:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432515.025291:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432515.025700:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609394176:0@lo:400:kworker.0 00000100:00100000:2.0:1787432515.026051:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609393792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6166us (6276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432515.026060:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1787432515.026151:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039ab480 x1874258609393792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432515.026195:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609393792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432515.094887:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432515.094941:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432515.094970:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432515.094991:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588347264 00000100:00100000:0.0:1787432515.095001:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588347264 00000100:00100000:1.0:1787432515.095030:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588347392 00000100:00100000:1.0:1787432515.095036:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588347392 00000100:00100000:0.0:1787432515.095080:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 293 00000100:00100000:1.0:1787432515.095086:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588347520 00000100:00100000:1.0:1787432515.095090:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588347520 00000100:00100000:0.0:1787432515.095094:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+10:2403:x1874258588347264:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432515.095126:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 141 00000100:00100000:1.0:1787432515.095136:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588347392:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432515.095191:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+10:2403:x1874258588347264:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 102us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432515.095215:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 293 00000100:00100000:1.0:1787432515.095235:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588347392:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 99us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432515.095244:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 141 00000100:00100000:1.0:1787432515.095264:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 142 00000100:00100000:1.0:1787432515.095272:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588347520:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432515.095301:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588347520:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432515.095308:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 142 00000100:00080000:1.0:1787432515.095331:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432515.095335:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787432515.801017:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432516.558599:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830391b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609395328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432516.558715:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432516.558795:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609395328 00000100:00100000:0.0:1787432516.558804:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609395328 00000100:00100000:0.0:1787432516.558871:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787432516.558882:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609395328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432516.558940:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432516.558993:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609395328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432516.559000:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787432516.559043:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830391b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609395328:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787432516.811999:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432517.838393:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432518.859515:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432519.627469:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432519.627501:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609395456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432519.627596:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432519.627677:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609395584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432519.627700:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432519.627860:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609395456 00000100:00100000:3.0:1787432519.627870:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609395456 00000100:00100000:3.0:1787432519.627929:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609395584 00000100:00100000:3.0:1787432519.627933:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609395584 00000100:00100000:3.0:1787432519.627953:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787432519.627971:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609395456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432519.628005:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432519.628057:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609395456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432519.628066:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787432519.628084:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787432519.628091:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609395584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787432519.628101:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432519.628125:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609395584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432519.628130:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1787432519.628207:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787432519.628247:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948301e3a300 x1874258609395584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432519.628269:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609395584:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1787432519.628281:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303ad9c00 x1874258609395456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432519.628291:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609395456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432519.634568:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432519.634601:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830391b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609395712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432519.635100:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432519.635501:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609395712 00000100:00100000:3.0:1787432519.635513:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609395712 00000100:00100000:3.0:1787432519.635590:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787432519.635603:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609395712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787432519.635654:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787432519.636015:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609395712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 413us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432519.636026:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787432519.639057:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830391b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609395712:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787432519.886527:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432520.139895:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609395968:0@lo:400:kworker.0 00000100:00100000:1.0:1787432520.139984:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432520.140040:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609396480:0@lo:400:kworker.0 00000100:00100000:1.0:1787432520.140062:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432520.140081:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609396992:0@lo:400:kworker.0 00000100:00100000:1.0:1787432520.140097:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432520.140133:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787432520.140140:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609396096:0@lo:400:kworker.0 00000100:00100000:1.0:1787432520.140182:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432520.140204:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609396608:0@lo:400:kworker.0 00000100:00100000:1.0:1787432520.140225:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432520.140241:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609397120:0@lo:400:kworker.0 00000100:00100000:1.0:1787432520.140327:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432520.140385:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609395968 00000100:00100000:1.0:1787432520.140395:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609395968 00000100:00100000:1.0:1787432520.140435:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609396480 00000100:00100000:1.0:1787432520.140439:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609396480 00000100:00100000:1.0:1787432520.140460:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609396992 00000100:00100000:1.0:1787432520.140462:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609396992 00000100:00100000:1.0:1787432520.140472:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609396608 00000100:00100000:1.0:1787432520.140474:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609396608 00000100:00100000:1.0:1787432520.140483:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609397120 00000100:00100000:1.0:1787432520.140485:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609397120 00000100:00100000:1.0:1787432520.140500:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787432520.140509:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609395968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432520.140553:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609396096 00000100:00100000:1.0:1787432520.140556:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609395968:12345-0@lo:400:kworker.0 Request processed in 48us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432520.140560:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609396096 00000100:00100000:1.0:1787432520.140568:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787432520.140586:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787432520.140593:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609396480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432520.140603:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787432520.140615:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609396096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432520.140620:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609396480:12345-0@lo:400:kworker.0 Request processed in 26us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432520.140627:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787432520.140638:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787432520.140645:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609396992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432520.140670:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609396096:12345-0@lo:400:kworker.0 Request processed in 58us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432520.140682:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787432520.140683:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609396992:12345-0@lo:400:kworker.0 Request processed in 36us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432520.140691:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787432520.140705:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787432520.140712:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609396608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432520.140732:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609396608:12345-0@lo:400:kworker.0 Request processed in 22us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432520.140745:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787432520.140756:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787432520.140762:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609397120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432520.140787:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609397120:12345-0@lo:400:kworker.0 Request processed in 27us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432520.140792:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787432520.140829:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609396224:0@lo:400:kworker.0 00000100:00100000:1.0:1787432520.140855:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432520.140872:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609396736:0@lo:400:kworker.0 00000100:00100000:1.0:1787432520.140893:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432520.140913:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609397248:0@lo:400:kworker.0 00000100:00100000:0.0:1787432520.140921:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609396736 00000100:00100000:0.0:1787432520.140927:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609396736 00000100:00100000:1.0:1787432520.140933:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432520.140962:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787432520.140964:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609397248 00000100:00100000:1.0:1787432520.140969:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609395840:0@lo:400:kworker.0 00000100:00100000:0.0:1787432520.140977:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609397248 00000100:00100000:1.0:1787432520.140998:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432520.141015:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787432520.141024:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609396352:0@lo:400:kworker.0 00000100:00100000:0.0:1787432520.141026:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609396736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432520.141046:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432520.141059:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609396864:0@lo:400:kworker.0 00000100:00100000:1.0:1787432520.141073:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432520.141082:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609397376:0@lo:400:kworker.0 00000100:00100000:1.0:1787432520.141096:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787432520.141113:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432520.141120:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432520.141135:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432520.141155:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609396224 00000100:00100000:1.0:1787432520.141158:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609396224 00000100:00100000:1.0:1787432520.141198:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787432520.141205:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609396224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432520.141238:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609396224:12345-0@lo:400:kworker.0 Request processed in 33us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432520.141245:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787432520.141325:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609395840 00000100:00100000:2.0:1787432520.141329:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609395840 00000100:00100000:2.0:1787432520.141356:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787432520.141364:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3641:x1874258609395840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432520.141412:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609396736:12345-0@lo:400:kworker.0 Request processed in 388us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432520.141421:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3641:x1874258609395840:12345-0@lo:400:kworker.0 Request processed in 55us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432520.141425:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787432520.141434:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787432520.141444:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609396864 00000100:00100000:0.0:1787432520.141448:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609396864 00000100:00100000:0.0:1787432520.141468:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609397376 00000100:00100000:0.0:1787432520.141471:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609397376 00000100:00100000:2.0:1787432520.141476:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787432520.141487:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609397248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432520.141498:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787432520.141508:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609396864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432520.141524:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609397248:12345-0@lo:400:kworker.0 Request processed in 39us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432520.141531:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787432520.141546:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787432520.141552:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609397376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432520.141577:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405940000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609397376:12345-0@lo:400:kworker.0 Request processed in 26us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432520.141583:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787432520.141605:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432520.141615:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609397504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432520.141642:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432520.141669:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609396864:12345-0@lo:400:kworker.0 Request processed in 162us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432520.141678:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1787432520.141697:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432520.141712:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609395840:0@lo:400:kworker.0 00010000:00080000:2.0:1787432520.141738:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303ada300 x1874258609396864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432520.141749:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609396864:0@lo:400:kworker.0 00010000:00080000:2.0:1787432520.141772:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948433653b80 x1874258609397376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432520.141782:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609397376:0@lo:400:kworker.0 00000100:00100000:2.0:1787432520.141793:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609396224:0@lo:400:kworker.0 00010000:00080000:2.0:1787432520.141804:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303ad8000 x1874258609396736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432520.141813:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609396736:0@lo:400:kworker.0 00010000:00080000:2.0:1787432520.141825:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948433651f80 x1874258609397248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432520.141832:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609397248:0@lo:400:kworker.0 00000100:00100000:2.0:1787432520.141874:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609396096:0@lo:400:kworker.0 00010000:00080000:2.0:1787432520.141887:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303ad9180 x1874258609396608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432520.141896:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609396608:0@lo:400:kworker.0 00010000:00080000:2.0:1787432520.141905:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948433650a80 x1874258609397120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432520.141912:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609397120:0@lo:400:kworker.0 00000100:00100000:2.0:1787432520.141922:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609395968:0@lo:400:kworker.0 00000100:00100000:2.0:1787432520.141934:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609396480:0@lo:400:kworker.0 00000100:00100000:2.0:1787432520.141948:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609396992:0@lo:400:kworker.0 00000100:00100000:3.0:1787432520.142503:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609396352 00000100:00100000:3.0:1787432520.142509:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609396352 00000100:00100000:3.0:1787432520.142541:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787432520.142549:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609396352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432520.142601:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609396352:12345-0@lo:400:kworker.0 Request processed in 53us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432520.142608:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787432520.142635:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609397504 00000100:00100000:3.0:1787432520.142639:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609397504 00000100:00100000:3.0:1787432520.142659:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787432520.142665:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609397504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787432520.142685:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432520.142714:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609397504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432520.142719:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787432520.142750:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609396352:0@lo:400:kworker.0 00000100:00100000:3.0:1787432520.142764:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432520.142771:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609397632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432520.142804:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432520.142831:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609397632 00000100:00100000:3.0:1787432520.142834:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609397632 00000100:00100000:3.0:1787432520.142854:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787432520.142859:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609397632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787432520.142869:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432520.142894:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609397632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432520.142900:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1787432520.142924:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948301e3a300 x1874258609397632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432520.142939:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609397632:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787432520.143966:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f8cf100 x1874258609397504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432520.143987:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609397504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432520.213619:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432520.213675:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432520.213706:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432520.213758:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588347904 00000100:00100000:3.0:1787432520.213771:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588347904 00000100:00100000:3.0:1787432520.213853:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588347776 00000100:00100000:3.0:1787432520.213857:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588347776 00000100:00100000:3.0:1787432520.213903:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 149 00000100:00100000:3.0:1787432520.213915:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588347904:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432520.214017:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588347904:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 103us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432520.214025:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 149 00000100:00100000:3.0:1787432520.214045:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 150 00000100:00100000:3.0:1787432520.214052:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588347776:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432520.214080:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588347776:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432520.214086:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 150 00000100:00080000:3.0:1787432520.214104:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432520.214109:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787432520.214625:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588347648 00000100:00100000:2.0:1787432520.214634:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588347648 00000100:00100000:2.0:1787432520.214682:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 295 00000100:00100000:2.0:1787432520.214691:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:2403:x1874258588347648:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432520.214741:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+10:2403:x1874258588347648:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 51us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432520.214748:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 295 00010000:00010000:1.0:1787432520.910220:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787432521.191200:0:12005:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 17:01:58 (1787432518) === 00000100:00100000:3.0:1787432521.675647:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830391b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609397760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432521.675716:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432521.676637:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609397760 00000100:00100000:0.0:1787432521.676651:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609397760 00000100:00100000:0.0:1787432521.676721:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787432521.676733:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609397760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432521.676779:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432521.676864:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609397760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432521.676871:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787432521.677595:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830391b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609397760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432521.694194:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432521.694242:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588348032 00000100:00100000:3.0:1787432521.694253:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588348032 00000100:00100000:3.0:1787432521.694304:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 296 00000100:00100000:3.0:1787432521.694316:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+10:8759:x1874258588348032:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787432521.694332:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432521.694349:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303012e00/0xca72b3b33563ec61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4c81 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432521.694396:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303012e00/0xca72b3b33563ec61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c81 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432521.694408:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303012e00/0xca72b3b33563ec61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c81 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432521.694419:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303012e00, rc 0) 00000100:00100000:3.0:1787432521.694481:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+11:8759:x1874258588348032:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 168us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432521.694489:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 296 00000100:00100000:3.0:1787432521.712520:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432521.712597:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588348160 00000100:00100000:2.0:1787432521.712612:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588348160 00000100:00100000:2.0:1787432521.712686:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 297 00000100:00100000:2.0:1787432521.712699:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+11:8759:x1874258588348160:12345-192.168.204.24@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787432521.712912:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+11:8759:x1874258588348160:12345-192.168.204.24@tcp:501:mount.lustre.0 Request processed in 214us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432521.712921:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 297 00000100:00100000:3.0:1787432521.716332:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432521.716913:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588348288 00000100:00100000:2.0:1787432521.716927:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588348288 00000100:00100000:2.0:1787432521.716999:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 298 00000100:00100000:2.0:1787432521.717011:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+11:8759:x1874258588348288:12345-192.168.204.24@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787432521.717565:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+11:8759:x1874258588348288:12345-192.168.204.24@tcp:503:mount.lustre.0 Request processed in 552us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432521.717584:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 298 00000100:00100000:1.0:1787432521.727646:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432521.727828:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588348416 00000100:00100000:3.0:1787432521.727839:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588348416 00000100:00100000:3.0:1787432521.727914:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 299 00000100:00100000:3.0:1787432521.727927:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+11:8763:x1874258588348416:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787432521.728142:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+11:8763:x1874258588348416:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 215us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432521.728311:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 299 00000100:00100000:0.0:1787432521.759555:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432521.759766:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588348544 00000100:00100000:3.0:1787432521.759781:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588348544 00000100:00100000:3.0:1787432521.759961:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 300 00000100:00100000:3.0:1787432521.759972:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+11:8763:x1874258588348544:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787432521.760216:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+11:8763:x1874258588348544:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 243us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432521.760235:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 300 00000100:00100000:0.0:1787432521.765251:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432521.767411:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588348672 00000100:00100000:3.0:1787432521.767432:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588348672 00000100:00100000:3.0:1787432521.767518:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 301 00000100:00100000:3.0:1787432521.767532:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+11:8763:x1874258588348672:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787432521.767725:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+11:8763:x1874258588348672:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 196us (2488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432521.767735:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 301 00000100:00100000:1.0:1787432521.779805:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432521.779959:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588348800 00000100:00100000:3.0:1787432521.779973:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588348800 00000100:00100000:3.0:1787432521.780060:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 302 00000100:00100000:3.0:1787432521.780074:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+11:8759:x1874258588348800:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787432521.780105:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432521.780129:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303013400/0xca72b3b33563ec68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4cb2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432521.780373:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303013400/0xca72b3b33563ec68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cb2 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432521.780386:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303013400/0xca72b3b33563ec68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cb2 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432521.780397:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303013400, rc 0) 00000100:00100000:3.0:1787432521.780465:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+12:8759:x1874258588348800:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 395us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432521.780472:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 302 00000100:00100000:0.0:1787432521.786984:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432521.787704:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588348928 00000100:00100000:2.0:1787432521.787815:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588348928 00000100:00100000:2.0:1787432521.787958:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 303 00000100:00100000:2.0:1787432521.787970:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+12:8759:x1874258588348928:12345-192.168.204.24@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787432521.788003:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787432521.788031:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787432521.788035:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787432521.788039:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787432521.788042:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787432521.788044:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1787432521.797013:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+12:8759:x1874258588348928:12345-192.168.204.24@tcp:256:mount.lustre.0 Request processed in 9032us (10037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432521.797038:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 303 00000100:00100000:1.0:1787432521.805459:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432521.805569:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588349056 00000100:00100000:3.0:1787432521.805582:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588349056 00000100:00100000:3.0:1787432521.805658:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 304 00000100:00100000:3.0:1787432521.805671:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+12:8759:x1874258588349056:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787432521.805689:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432521.805710:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303012600/0xca72b3b33563ec6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4cb9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432521.805760:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303012600/0xca72b3b33563ec6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cb9 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432521.805773:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303012600/0xca72b3b33563ec6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cb9 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432521.805783:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303012600, rc 0) 00000100:00100000:3.0:1787432521.805862:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:8759:x1874258588349056:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 194us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432521.805871:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 304 00000100:00100000:3.0:1787432521.810344:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432521.810511:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588349184 00000100:00100000:2.0:1787432521.810522:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588349184 00000100:00100000:2.0:1787432521.810578:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 305 00000100:00100000:2.0:1787432521.810587:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948406122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:8759:x1874258588349184:12345-192.168.204.24@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787432521.810762:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948406122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:8759:x1874258588349184:12345-192.168.204.24@tcp:501:mount.lustre.0 Request processed in 174us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432521.810770:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 305 00000100:00100000:0.0:1787432521.818574:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432521.818681:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588349312 00000100:00100000:2.0:1787432521.818692:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588349312 00000100:00100000:2.0:1787432521.818763:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 306 00000100:00100000:2.0:1787432521.818773:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948406120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:8759:x1874258588349312:12345-192.168.204.24@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787432521.818939:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948406120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:8759:x1874258588349312:12345-192.168.204.24@tcp:503:mount.lustre.0 Request processed in 167us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432521.818948:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 306 00000100:00100000:1.0:1787432521.823926:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432521.824275:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588349440 00000100:00100000:3.0:1787432521.824289:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588349440 00000100:00100000:3.0:1787432521.824536:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 307 00000100:00100000:3.0:1787432521.824551:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948406122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:8767:x1874258588349440:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787432521.824747:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948406122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:8767:x1874258588349440:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 199us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432521.824757:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 307 00000100:00100000:0.0:1787432521.828832:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432521.828936:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588349568 00000100:00100000:3.0:1787432521.828966:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588349568 00000100:00100000:3.0:1787432521.829051:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 308 00000100:00100000:3.0:1787432521.829065:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:8767:x1874258588349568:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787432521.829328:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:8767:x1874258588349568:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 264us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432521.829337:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 308 00000100:00100000:0.0:1787432521.835371:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432521.839111:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588349696 00000100:00100000:1.0:1787432521.839130:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588349696 00000100:00100000:1.0:1787432521.839229:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:1.0:1787432521.839242:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830391aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1874258588349696:12345-192.168.204.24@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787432521.839278:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0f5e99cc-19dc-4ba3-b74b-91816a9b078c@192.168.204.24@tcp t0 exp 0000000000000000 cur 332 last 0 00000020:00000080:1.0:1787432521.839322:0:6514:0:(genops.c:1385:class_connect()) connect: client 0f5e99cc-19dc-4ba3-b74b-91816a9b078c, cookie 0xca72b3b33563ec76 00000004:00100000:1.0:1787432521.839371:0:6514:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787432521.839509:0:6514:0:(import.c:65:import_set_state_nolock()) ffff94843f833800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432521.839601:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830391aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2399:x1874258588349696:12345-192.168.204.24@tcp:38:mount.lustre.0 Request processed in 359us (4252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432521.839610:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:1.0:1787432521.843400:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432521.843444:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432521.843542:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432521.846008:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432521.849286:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588349952 00000100:00100000:3.0:1787432521.849304:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588349952 00000100:00100000:3.0:1787432521.849569:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588349824 00000100:00100000:3.0:1787432521.849575:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588349824 00000100:00100000:3.0:1787432521.849626:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588350208 00000100:00100000:3.0:1787432521.849630:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588350208 00000100:00100000:3.0:1787432521.849655:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:3.0:1787432521.849664:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1874258588349952:12345-192.168.204.24@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787432521.849703:0:10165:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 0f5e99cc-19dc-4ba3-b74b-91816a9b078c@192.168.204.24@tcp t0 exp 0000000000000000 cur 332 last 0 00000020:00000080:3.0:1787432521.849749:0:10165:0:(genops.c:1385:class_connect()) connect: client 0f5e99cc-19dc-4ba3-b74b-91816a9b078c, cookie 0xca72b3b33563ec7d 00000004:00100000:3.0:1787432521.849780:0:10165:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787432521.849998:0:10165:0:(import.c:65:import_set_state_nolock()) ffff9483039eb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432521.850190:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2399:x1874258588349952:12345-192.168.204.24@tcp:38:mount.lustre.0 Request processed in 497us (6773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432521.850199:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:3.0:1787432521.850223:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00100000:3.0:1787432521.850231:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+7:0:x1874258588349824:12345-192.168.204.24@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787432521.850260:0:10165:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787432521.850315:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+7:0:x1874258588349824:12345-192.168.204.24@tcp:41:mount.lustre.0 Request processed in 85us (6869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432521.850345:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00100000:3.0:1787432521.850359:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 19 00000100:00080000:2.0:1787432521.850508:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432521.850647:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588350464 00000100:00100000:1.0:1787432521.850653:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588350464 00000100:00100000:3.0:1787432521.850886:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432521.850909:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588350336 00000100:00100000:3.0:1787432521.850913:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588350336 00000100:00100000:2.0:1787432521.850964:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:8759:x1874258588350208:12345-192.168.204.24@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787432521.850980:0:10165:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787432521.851012:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:8759:x1874258588350208:12345-192.168.204.24@tcp:41:mount.lustre.0 Request processed in 280us (7471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432521.855621:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 151 00000100:00100000:1.0:1787432521.855652:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588350464:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432521.855772:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588350464:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 134us (9779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432521.856192:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 151 00000100:00100000:3.0:1787432521.859350:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 152 00000100:00100000:3.0:1787432521.860058:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588350336:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432521.860222:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588350336:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 857us (9337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432521.860233:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 152 00000100:00100000:2.0:1787432521.860483:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 19 00000100:00100000:1.0:1787432521.860580:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432521.866949:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432521.867346:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588350592 00000100:00100000:0.0:1787432521.867359:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588350592 00000100:00100000:0.0:1787432521.868381:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00100000:0.0:1787432521.868396:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f85a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:8759:x1874258588350592:12345-192.168.204.24@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787432521.868499:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f85a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:8759:x1874258588350592:12345-192.168.204.24@tcp:40:mount.lustre.0 Request processed in 107us (7919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432521.868507:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00100000:3.0:1787432521.869648:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588350080 00000100:00100000:3.0:1787432521.869660:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588350080 00000100:00100000:2.0:1787432521.869915:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:2.0:1787432521.869929:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:0:x1874258588350080:12345-192.168.204.24@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787432521.869958:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787432521.870254:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:0:x1874258588350080:12345-192.168.204.24@tcp:41:mount.lustre.0 Request processed in 326us (3314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432521.870263:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00080000:3.0:1787432521.872607:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432521.874765:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432521.874818:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432521.874915:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588350976 00000100:00100000:3.0:1787432521.874929:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588350976 00000100:00100000:3.0:1787432521.875003:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 5 00000100:00100000:3.0:1787432521.875014:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:8759:x1874258588350976:12345-192.168.204.24@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787432521.875325:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:8759:x1874258588350976:12345-192.168.204.24@tcp:900:mount.lustre.0 Request processed in 311us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432521.875334:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 5 00000100:00100000:2.0:1787432521.875486:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588350720 00000100:00100000:2.0:1787432521.875492:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588350720 00000100:00100000:2.0:1787432521.875534:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00100000:2.0:1787432521.875540:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1874258588350720:12345-192.168.204.24@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787432521.875569:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0f5e99cc-19dc-4ba3-b74b-91816a9b078c@192.168.204.24@tcp t0 exp 0000000000000000 cur 332 last 0 00000020:00000080:2.0:1787432521.875603:0:8432:0:(genops.c:1385:class_connect()) connect: client 0f5e99cc-19dc-4ba3-b74b-91816a9b078c, cookie 0xca72b3b33563ec84 00002000:00100000:2.0:1787432521.875615:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0f5e99cc-19dc-4ba3-b74b-91816a9b078c/ffff94843f869800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787432521.875632:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787432521.875741:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787432521.875773:0:8432:0:(import.c:65:import_set_state_nolock()) ffff94843f869000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432521.875812:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2399:x1874258588350720:12345-192.168.204.24@tcp:8:mount.lustre.0 Request processed in 271us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432521.875820:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00100000:0.0:1787432521.878810:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432521.878958:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588350848 00000100:00100000:2.0:1787432521.878970:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588350848 00000100:00100000:2.0:1787432521.879030:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:2.0:1787432521.879041:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830391ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1874258588350848:12345-192.168.204.24@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787432521.879085:0:8806:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0f5e99cc-19dc-4ba3-b74b-91816a9b078c@192.168.204.24@tcp t0 exp 0000000000000000 cur 332 last 0 00000020:00000080:2.0:1787432521.879133:0:8806:0:(genops.c:1385:class_connect()) connect: client 0f5e99cc-19dc-4ba3-b74b-91816a9b078c, cookie 0xca72b3b33563ec8b 00002000:00100000:2.0:1787432521.879147:0:8806:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0f5e99cc-19dc-4ba3-b74b-91816a9b078c/ffff94843f86f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787432521.879161:0:8806:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787432521.879301:0:8806:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787432521.879351:0:8806:0:(import.c:65:import_set_state_nolock()) ffff94843f86a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432521.879514:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830391ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2399:x1874258588350848:12345-192.168.204.24@tcp:8:mount.lustre.0 Request processed in 472us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432521.879523:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:1.0:1787432521.882779:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432521.882944:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588351104 00000100:00100000:0.0:1787432521.882956:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588351104 00000100:00100000:0.0:1787432521.883030:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1 00000100:00100000:0.0:1787432521.883042:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:8759:x1874258588351104:12345-192.168.204.24@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787432521.883157:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787432521.883299:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:8759:x1874258588351104:12345-192.168.204.24@tcp:33:mount.lustre.0 Request processed in 259us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432521.883307:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1 00010000:00010000:0.0:1787432521.933122:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432522.973481:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432523.979537:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432524.747682:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432524.747715:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609397888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432524.747814:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432524.748013:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609397888 00000100:00100000:0.0:1787432524.748024:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609397888 00000100:00100000:0.0:1787432524.748092:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787432524.748103:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609397888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432524.748146:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787432524.748238:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609397888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432524.748259:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787432524.748424:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609397888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432524.751656:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609398016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787432524.751745:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432524.751809:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609398016 00000100:00100000:3.0:1787432524.751817:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609398016 00000100:00100000:3.0:1787432524.751866:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787432524.751875:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435dd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609398016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787432524.751904:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432524.751944:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435dd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609398016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432524.751952:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1787432524.752219:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787432524.752252:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303914380 x1874258609398016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432524.752270:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609398016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432524.752368:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432524.752376:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830391bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609398144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432524.752405:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432524.752429:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609398144 00000100:00100000:0.0:1787432524.752433:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609398144 00000100:00100000:0.0:1787432524.752465:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787432524.752472:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830391a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609398144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432524.752485:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432524.752516:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830391a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609398144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432524.752522:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1787432524.752538:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787432524.752554:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830391bb80 x1874258609398144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432524.752566:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830391bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609398144:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787432525.005629:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432525.263047:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609398528:0@lo:400:kworker.0 00000100:00100000:0.0:1787432525.263138:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432525.263214:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609399040:0@lo:400:kworker.0 00000100:00100000:0.0:1787432525.263240:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432525.263265:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609399552:0@lo:400:kworker.0 00000100:00100000:0.0:1787432525.263285:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432525.263329:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787432525.263335:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609398656:0@lo:400:kworker.0 00000100:00100000:0.0:1787432525.263375:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432525.263395:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609399168:0@lo:400:kworker.0 00000100:00100000:0.0:1787432525.263418:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432525.263435:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609399680:0@lo:400:kworker.0 00000100:00100000:0.0:1787432525.263454:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432525.263490:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609398528 00000100:00100000:0.0:1787432525.263497:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609398528 00000100:00100000:0.0:1787432525.263553:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787432525.263561:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830391bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609398528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432525.266913:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830391bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609398528:12345-0@lo:400:kworker.0 Request processed in 3342us (3764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432525.266929:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787432525.266987:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609399040 00000100:00100000:0.0:1787432525.266995:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609399040 00000100:00100000:0.0:1787432525.267053:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609399552 00000100:00100000:0.0:1787432525.267057:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609399552 00000100:00100000:0.0:1787432525.267080:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609398656 00000100:00100000:0.0:1787432525.267083:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609398656 00000100:00100000:0.0:1787432525.267101:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787432525.267109:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830391a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609399040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432525.267147:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830391a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609399040:12345-0@lo:400:kworker.0 Request processed in 39us (3905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432525.267152:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787432525.267179:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787432525.267186:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609399552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432525.267214:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609399552:12345-0@lo:400:kworker.0 Request processed in 29us (3928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432525.267241:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787432525.267253:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787432525.267258:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830391b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609398656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432525.267293:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830391b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609398656:12345-0@lo:400:kworker.0 Request processed in 34us (3917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432525.267299:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787432525.267328:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609399168 00000100:00100000:0.0:1787432525.267333:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609399168 00000100:00100000:0.0:1787432525.267359:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609399680 00000100:00100000:0.0:1787432525.267362:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609399680 00000100:00100000:0.0:1787432525.267386:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787432525.267393:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609399168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432525.267429:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609399168:12345-0@lo:400:kworker.0 Request processed in 37us (4010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432525.267435:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787432525.267447:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787432525.267454:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609399680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432525.267483:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609399680:12345-0@lo:400:kworker.0 Request processed in 30us (4028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432525.267490:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1787432525.267515:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787432525.267521:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787432525.267975:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609398656:0@lo:400:kworker.0 00010000:00080000:0.0:1787432525.267991:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f921500 x1874258609399168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432525.268003:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609399168:0@lo:400:kworker.0 00010000:00080000:0.0:1787432525.268037:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039a8e00 x1874258609399680/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432525.268047:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609399680:0@lo:400:kworker.0 00000100:00100000:0.0:1787432525.268061:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609398528:0@lo:400:kworker.0 00010000:00080000:0.0:1787432525.268071:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f921f80 x1874258609399040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432525.268080:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609399040:0@lo:400:kworker.0 00010000:00080000:0.0:1787432525.268092:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039aad80 x1874258609399552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432525.268099:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609399552:0@lo:400:kworker.0 00000100:00100000:2.0:1787432525.268909:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609398400:0@lo:400:kworker.0 00000100:00100000:2.0:1787432525.268975:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432525.269015:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609398912:0@lo:400:kworker.0 00000100:00100000:2.0:1787432525.269048:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432525.269077:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609399424:0@lo:400:kworker.0 00000100:00100000:2.0:1787432525.269098:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432525.269139:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787432525.269148:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609398272:0@lo:400:kworker.0 00000100:00100000:2.0:1787432525.269362:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432525.269385:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609398784:0@lo:400:kworker.0 00000100:00100000:2.0:1787432525.269411:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432525.269428:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609399296:0@lo:400:kworker.0 00000100:00100000:2.0:1787432525.269450:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432525.269468:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609399808:0@lo:400:kworker.0 00000100:00100000:2.0:1787432525.269487:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432525.269521:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609399296 00000100:00100000:2.0:1787432525.269528:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609399296 00000100:00100000:1.0:1787432525.269745:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609398400 00000100:00100000:1.0:1787432525.269749:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609398400 00000100:00100000:1.0:1787432525.269778:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609398912 00000100:00100000:1.0:1787432525.269781:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609398912 00000100:00100000:1.0:1787432525.269800:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609399424 00000100:00100000:1.0:1787432525.269803:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609399424 00000100:00100000:1.0:1787432525.269818:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787432525.269826:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609398400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432525.269891:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609398400:12345-0@lo:400:kworker.0 Request processed in 65us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432525.269899:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787432525.269915:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787432525.269922:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609398912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432525.269951:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609398912:12345-0@lo:400:kworker.0 Request processed in 31us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432525.269966:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787432525.269977:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787432525.269983:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609399424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432525.270013:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609399424:12345-0@lo:400:kworker.0 Request processed in 30us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432525.270019:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787432525.270245:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609399808 00000100:00100000:2.0:1787432525.270249:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609399808 00000100:00100000:2.0:1787432525.270270:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787432525.270277:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609399296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432525.270380:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787432525.270389:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609399808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432525.270423:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609399808:12345-0@lo:400:kworker.0 Request processed in 36us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432525.270429:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787432525.270497:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609399296:12345-0@lo:400:kworker.0 Request processed in 219us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432525.270504:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787432525.270530:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609398272 00000100:00100000:2.0:1787432525.270534:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609398272 00000100:00100000:2.0:1787432525.270617:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1787432525.270625:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3642:x1874258609398272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432525.270657:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3642:x1874258609398272:12345-0@lo:400:kworker.0 Request processed in 33us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432525.270664:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:0.0:1787432525.270756:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787432525.270761:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432525.272263:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432525.272290:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609399936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432525.272360:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432525.272421:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609399936 00000100:00100000:3.0:1787432525.272427:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609399936 00000100:00100000:3.0:1787432525.272467:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787432525.272475:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609399936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787432525.272507:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432525.272556:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609399936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432525.272563:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1787432525.272614:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484348de300 x1874258609399936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432525.272647:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609399936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432525.273226:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432525.273239:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609400064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432525.273274:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432525.273300:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609400064 00000100:00100000:3.0:1787432525.273305:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609400064 00000100:00100000:3.0:1787432525.273331:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787432525.273339:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609400064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787432525.273352:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432525.273385:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609400064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432525.273390:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1787432525.273420:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303915500 x1874258609400064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432525.273434:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609400064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432525.280544:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609398784 00000100:00100000:1.0:1787432525.280565:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609398784 00000100:00100000:1.0:1787432525.280655:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787432525.280668:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609398784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432525.280775:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609398784:12345-0@lo:400:kworker.0 Request processed in 109us (11362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432525.280783:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787432525.286041:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609398272:0@lo:400:kworker.0 00000100:00100000:2.0:1787432525.286087:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609398784:0@lo:400:kworker.0 00010000:00080000:2.0:1787432525.286108:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039a8a80 x1874258609399296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432525.286122:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609399296:0@lo:400:kworker.0 00010000:00080000:2.0:1787432525.286134:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039ab100 x1874258609399808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432525.286143:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609399808:0@lo:400:kworker.0 00000100:00100000:2.0:1787432525.286158:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609398400:0@lo:400:kworker.0 00000100:00100000:2.0:1787432525.287507:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609398912:0@lo:400:kworker.0 00000100:00100000:2.0:1787432525.287525:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609399424:0@lo:400:kworker.0 00010000:00010000:2.0:1787432526.027942:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432526.802006:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609400192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432526.802128:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432526.802621:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609400192 00000100:00100000:0.0:1787432526.802634:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609400192 00000100:00100000:0.0:1787432526.802707:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787432526.802719:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609400192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432526.802765:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432526.802849:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609400192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432526.802856:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787432526.803004:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609400192:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787432527.051646:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432527.417107:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432527.417159:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432527.417202:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432527.417228:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432527.417269:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432527.417286:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432527.417309:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432527.417378:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588352000 00000100:00100000:1.0:1787432527.417388:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588352000 00000100:00100000:1.0:1787432527.417449:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588351872 00000100:00100000:1.0:1787432527.417453:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588351872 00000100:00100000:1.0:1787432527.417475:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 46 00000100:00100000:1.0:1787432527.417486:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2402:x1874258588352000:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432527.417555:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2402:x1874258588352000:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 71us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432527.417575:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 46 00000100:00100000:1.0:1787432527.417593:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 47 00000100:00100000:1.0:1787432527.417600:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2402:x1874258588351872:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432527.417626:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2402:x1874258588351872:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432527.417632:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 47 00000100:00100000:0.0:1787432527.418927:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588351488 00000100:00100000:0.0:1787432527.418942:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588351488 00000100:00100000:0.0:1787432527.419017:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588351744 00000100:00100000:0.0:1787432527.419021:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588351744 00000100:00100000:0.0:1787432527.419036:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588351360 00000100:00100000:0.0:1787432527.419054:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588351360 00000100:00100000:0.0:1787432527.419074:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588351616 00000100:00100000:0.0:1787432527.419077:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588351616 00000100:00100000:0.0:1787432527.419097:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 159 00000100:00100000:0.0:1787432527.419108:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588351488:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432527.419213:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588351488:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 107us (2053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432527.419221:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 159 00000100:00100000:0.0:1787432527.419240:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 160 00000100:00100000:0.0:1787432527.419246:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2402:x1874258588351744:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432527.419267:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2402:x1874258588351744:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 22us (2065us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432527.419273:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 160 00000100:00100000:0.0:1787432527.419283:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 161 00000100:00100000:0.0:1787432527.419289:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2402:x1874258588351360:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432527.419310:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2402:x1874258588351360:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 21us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432527.419316:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 161 00000100:00100000:0.0:1787432527.419326:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 162 00000100:00100000:0.0:1787432527.419334:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2402:x1874258588351616:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432527.419356:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2402:x1874258588351616:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432527.419362:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 162 00000100:00080000:0.0:1787432527.419390:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787432527.419400:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787432527.419403:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787432527.419406:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432527.420407:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588351232 00000100:00100000:3.0:1787432527.420423:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588351232 00000100:00100000:3.0:1787432527.420505:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 310 00000100:00100000:3.0:1787432527.420518:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:2402:x1874258588351232:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432527.420592:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:2402:x1874258588351232:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 77us (3510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432527.420615:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 310 00000001:00100000:2.0:1787432527.826923:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0f5e99cc-19dc-4ba3-b74b-91816a9b078c 00000001:00100000:0.0:1787432527.828307:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0f5e99cc-19dc-4ba3-b74b-91816a9b078c 00000001:00100000:2.0:1787432527.830378:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0f5e99cc-19dc-4ba3-b74b-91816a9b078c 00000001:00100000:0.0:1787432527.832354:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0f5e99cc-19dc-4ba3-b74b-91816a9b078c 00010000:00010000:1.0:1787432528.076150:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787432528.586302:0:12200:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1787432529.101080:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432529.867502:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609400320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432529.867602:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432529.867712:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609400320 00000100:00100000:2.0:1787432529.867720:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609400320 00000100:00100000:2.0:1787432529.867786:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787432529.867800:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609400320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432529.867836:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787432529.868898:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432529.869335:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609400448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432529.869639:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609400576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432529.869694:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432529.869878:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1787432529.869901:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1787432529.870338:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609400576 00000100:00100000:1.0:1787432529.870348:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609400576 00000100:00100000:2.0:1787432529.870524:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787432529.870549:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609400576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787432529.870583:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432529.870667:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609400576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432529.870675:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1787432529.870878:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435ba8700 x1874258609400576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432529.870910:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609400576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432529.871702:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609400320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3903us (4096us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432529.871711:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1787432529.871853:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484348dca80 x1874258609400320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432529.871883:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609400320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432529.872096:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787432529.872189:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432529.884316:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609400448 00000100:00100000:1.0:1787432529.884335:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609400448 00000100:00100000:1.0:1787432529.884425:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787432529.884436:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609400448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787432529.884478:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787432529.884579:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609400448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (12482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432529.884587:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787432529.884637:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609400448:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787432530.123642:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432530.379494:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432530.379686:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609400832:0@lo:400:kworker.0 00000100:00100000:2.0:1787432530.379804:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432530.379873:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432530.379881:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609400960:0@lo:400:kworker.0 00000100:00100000:2.0:1787432530.379910:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432530.379959:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609400832 00000100:00100000:2.0:1787432530.379968:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609400832 00000100:00100000:2.0:1787432530.380018:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787432530.380026:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609400832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432530.380073:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609400832:12345-0@lo:400:kworker.0 Request processed in 47us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432530.380079:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787432530.380118:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609400832:0@lo:400:kworker.0 00000100:00100000:1.0:1787432530.381023:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609401088:0@lo:400:kworker.0 00000100:00100000:1.0:1787432530.381065:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432530.381098:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609400704:0@lo:400:kworker.0 00000100:00100000:1.0:1787432530.381127:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432530.381151:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432530.381156:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609401216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432530.381197:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432530.381230:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609400960 00000100:00100000:1.0:1787432530.381236:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609400960 00000100:00100000:1.0:1787432530.381275:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787432530.381282:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609400960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432530.381326:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609400960:12345-0@lo:400:kworker.0 Request processed in 44us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432530.381332:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787432530.381363:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609401088 00000100:00100000:1.0:1787432530.381366:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609401088 00000100:00100000:1.0:1787432530.381389:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787432530.381396:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609401088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432530.381432:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609401088:12345-0@lo:400:kworker.0 Request processed in 36us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432530.381438:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787432530.381456:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609401216 00000100:00100000:1.0:1787432530.381459:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609401216 00000100:00100000:1.0:1787432530.381493:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787432530.381500:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609401216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787432530.381519:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432530.381551:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609401216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432530.381557:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1787432530.381578:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432530.381617:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609400960:0@lo:400:kworker.0 00010000:00080000:1.0:1787432530.381647:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f8cea00 x1874258609401216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432530.381662:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609401216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432530.381672:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609401088:0@lo:400:kworker.0 00000100:00100000:0.0:1787432530.387768:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609401472:0@lo:400:kworker.0 00000100:00100000:0.0:1787432530.388005:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432530.388054:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609401984:0@lo:400:kworker.0 00000100:00100000:0.0:1787432530.388075:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432530.388114:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787432530.388120:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609401344:0@lo:400:kworker.0 00000100:00100000:0.0:1787432530.388147:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432530.388189:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609401856:0@lo:400:kworker.0 00000100:00100000:0.0:1787432530.388214:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432530.388271:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609401472 00000100:00100000:0.0:1787432530.388277:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609401472 00000100:00100000:0.0:1787432530.388328:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609401984 00000100:00100000:0.0:1787432530.388331:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609401984 00000100:00100000:0.0:1787432530.388352:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787432530.388360:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609401472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432530.388410:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609401472:12345-0@lo:400:kworker.0 Request processed in 50us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432530.388418:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787432530.388436:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787432530.388442:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609401984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432530.388471:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609401984:12345-0@lo:400:kworker.0 Request processed in 30us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432530.388495:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787432530.388539:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609401472:0@lo:400:kworker.0 00000100:00100000:0.0:1787432530.388550:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609401984:0@lo:400:kworker.0 00000100:00100000:0.0:1787432530.388566:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432530.388573:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609402368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787432530.388723:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609401344 00000100:00100000:1.0:1787432530.388728:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609401344 00000100:00100000:1.0:1787432530.388759:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787432530.388765:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609401344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432530.388820:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609401344:12345-0@lo:400:kworker.0 Request processed in 54us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432530.388833:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787432530.388853:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609401856 00000100:00100000:1.0:1787432530.388856:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609401856 00000100:00100000:1.0:1787432530.388883:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787432530.388890:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609401856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432530.388936:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609401856:12345-0@lo:400:kworker.0 Request processed in 46us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432530.388942:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787432530.388965:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432530.388989:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609401600:0@lo:400:kworker.0 00000100:00100000:1.0:1787432530.389015:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432530.389032:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609402112:0@lo:400:kworker.0 00000100:00100000:1.0:1787432530.389049:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432530.389065:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787432530.389070:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609401728:0@lo:400:kworker.0 00000100:00100000:1.0:1787432530.389089:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432530.389103:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609402240:0@lo:400:kworker.0 00000100:00100000:1.0:1787432530.389119:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432530.389141:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609401600 00000100:00100000:1.0:1787432530.389144:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609401600 00000100:00100000:1.0:1787432530.389183:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609402112 00000100:00100000:1.0:1787432530.389186:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609402112 00000100:00100000:1.0:1787432530.389201:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787432530.389207:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609401600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432530.389239:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609401600:12345-0@lo:400:kworker.0 Request processed in 32us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432530.389254:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787432530.389266:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787432530.389272:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609402112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432530.389297:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609402112:12345-0@lo:400:kworker.0 Request processed in 26us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432530.389302:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787432530.389317:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609401728 00000100:00100000:1.0:1787432530.389320:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609401728 00000100:00100000:1.0:1787432530.389335:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609402240 00000100:00100000:1.0:1787432530.389337:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609402240 00000100:00100000:1.0:1787432530.389350:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787432530.389356:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435baaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609401728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432530.389381:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435baaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609401728:12345-0@lo:400:kworker.0 Request processed in 25us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432530.389386:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787432530.389397:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787432530.389402:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609402240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432530.389428:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609402240:12345-0@lo:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432530.389433:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1787432530.389456:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432530.389459:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787432530.389489:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484348dce00 x1874258609401728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432530.389502:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609401728:0@lo:400:kworker.0 00010000:00080000:1.0:1787432530.389512:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f923100 x1874258609402240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432530.389527:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609402240:0@lo:400:kworker.0 00010000:00080000:1.0:1787432530.389539:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484348de300 x1874258609401600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432530.389547:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609401600:0@lo:400:kworker.0 00010000:00080000:1.0:1787432530.389556:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f920380 x1874258609402112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432530.389564:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609402112:0@lo:400:kworker.0 00000100:00100000:2.0:1787432530.390004:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609400704 00000100:00100000:2.0:1787432530.390010:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609400704 00000100:00100000:2.0:1787432530.390047:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1787432530.390055:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609400704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432530.390098:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609400704:12345-0@lo:400:kworker.0 Request processed in 44us (8969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432530.390112:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787432530.390236:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432530.390273:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609401344:0@lo:400:kworker.0 00010000:00080000:0.0:1787432530.390285:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484348ded80 x1874258609401856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432530.390292:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609401856:0@lo:400:kworker.0 00000100:00100000:1.0:1787432530.390505:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609400704:0@lo:400:kworker.0 00000100:00100000:2.0:1787432530.390893:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609402368 00000100:00100000:2.0:1787432530.390899:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609402368 00000100:00100000:2.0:1787432530.390941:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787432530.390949:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609402368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787432530.390966:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432530.391016:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609402368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (2415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432530.391023:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1787432530.391243:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f921500 x1874258609402368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432530.391259:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609402368:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787432531.150012:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432531.915823:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609402496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432531.915914:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432531.915997:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609402496 00000100:00100000:0.0:1787432531.916005:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609402496 00000100:00100000:0.0:1787432531.916054:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787432531.916064:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609402496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432531.916094:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432531.916148:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609402496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432531.916154:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787432531.916226:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609402496:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787432532.173147:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432532.505920:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432532.506120:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432532.506199:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432532.506278:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432532.506300:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432532.506324:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432532.506428:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432532.506610:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588352256 00000100:00100000:1.0:1787432532.506769:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588352256 00000100:00100000:1.0:1787432532.506838:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588352384 00000100:00100000:1.0:1787432532.506842:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588352384 00000100:00100000:1.0:1787432532.506858:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588352512 00000100:00100000:1.0:1787432532.506861:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588352512 00000100:00100000:1.0:1787432532.506877:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588352640 00000100:00100000:1.0:1787432532.506892:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588352640 00000100:00100000:1.0:1787432532.506911:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 169 00000100:00100000:1.0:1787432532.506930:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2400:x1874258588352256:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432532.507017:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2400:x1874258588352256:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 89us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432532.507027:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 169 00000100:00100000:0.0:1787432532.507052:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 170 00000100:00100000:0.0:1787432532.507238:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588352384:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432532.507280:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588352384:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 47us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432532.507643:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 171 00000100:00100000:1.0:1787432532.507654:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588352512:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432532.507684:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588352512:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 34us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432532.507691:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 171 00000100:00100000:1.0:1787432532.507708:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 172 00000100:00100000:1.0:1787432532.507716:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588352640:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432532.507742:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588352640:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432532.507748:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 172 00000100:00100000:1.0:1787432532.507770:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588352896 00000100:00100000:1.0:1787432532.507775:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588352896 00000100:00100000:1.0:1787432532.508569:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588352768 00000100:00100000:1.0:1787432532.508577:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588352768 00000100:00100000:1.0:1787432532.508614:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 51 00000100:00100000:1.0:1787432532.508622:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588352896:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432532.508668:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588352896:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 48us (2343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432532.508675:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 51 00000100:00100000:1.0:1787432532.508690:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00100000:1.0:1787432532.508715:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588352768:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432532.508743:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588352768:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (2315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432532.508750:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00080000:1.0:1787432532.508776:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787432532.508780:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432532.508783:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432532.508787:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432532.510701:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 170 00000100:00100000:2.0:1787432532.510975:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588352128 00000100:00100000:2.0:1787432532.510985:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588352128 00000100:00100000:2.0:1787432532.511850:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 312 00000100:00100000:2.0:1787432532.511866:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588352128:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432532.511958:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588352128:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 97us (6053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432532.511966:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 312 00010000:00010000:1.0:1787432533.197298:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432534.219480:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432534.988310:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609402624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432534.988393:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432534.988470:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609402624 00000100:00100000:1.0:1787432534.988478:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609402624 00000100:00100000:1.0:1787432534.988592:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787432534.988603:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609402624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432534.988632:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432534.988678:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609402624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432534.988686:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1787432534.988706:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787432534.988739:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303a9d500 x1874258609402624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432534.988758:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609402624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432534.989297:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609402880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432534.989338:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432534.991042:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609402752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432534.991111:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432534.991207:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609402752 00000100:00100000:1.0:1787432534.991215:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609402752 00000100:00100000:1.0:1787432534.991273:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787432534.991282:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609402752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787432534.991308:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432534.991353:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609402752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432534.991361:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1787432534.991383:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787432534.991423:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303916680 x1874258609402752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432534.991444:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609402752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787432534.994423:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609402880 00000100:00100000:3.0:1787432534.994440:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609402880 00000100:00100000:3.0:1787432534.994499:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787432534.994510:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609402880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787432534.994549:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787432534.994637:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609402880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (5297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432534.994645:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787432534.994699:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609402880:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787432535.251231:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432535.499599:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432535.499623:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609403008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432535.499693:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432535.499905:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609403008 00000100:00100000:1.0:1787432535.499913:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609403008 00000100:00100000:1.0:1787432535.499982:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787432535.499994:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609403008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787432535.500028:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432535.500080:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609403008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432535.500087:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:1.0:1787432535.500131:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f921500 x1874258609403008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432535.500151:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609403008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787432535.500547:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609403136:0@lo:400:kworker.0 00000100:00100000:1.0:1787432535.500581:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432535.500620:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609403648:0@lo:400:kworker.0 00000100:00100000:1.0:1787432535.500644:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432535.500661:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609404160:0@lo:400:kworker.0 00000100:00100000:1.0:1787432535.500681:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432535.500699:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787432535.500704:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609403264:0@lo:400:kworker.0 00000100:00100000:1.0:1787432535.500723:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432535.500739:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609403776:0@lo:400:kworker.0 00000100:00100000:1.0:1787432535.500758:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432535.500785:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609403648 00000100:00100000:1.0:1787432535.500789:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609403648 00000100:00100000:1.0:1787432535.500833:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609403264 00000100:00100000:1.0:1787432535.500837:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609403264 00000100:00100000:1.0:1787432535.500857:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609403776 00000100:00100000:1.0:1787432535.500860:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609403776 00000100:00100000:1.0:1787432535.500875:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787432535.500882:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609403648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432535.500919:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609403648:12345-0@lo:400:kworker.0 Request processed in 38us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432535.500925:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787432535.500939:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787432535.500945:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609403264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432535.500970:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609403264:12345-0@lo:400:kworker.0 Request processed in 26us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432535.500975:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787432535.500985:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787432535.500991:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609403776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432535.501025:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609403776:12345-0@lo:400:kworker.0 Request processed in 35us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432535.501032:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787432535.501050:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609404160 00000100:00100000:1.0:1787432535.501054:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609404160 00000100:00100000:1.0:1787432535.501079:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787432535.501085:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609404160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432535.501111:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609404160:12345-0@lo:400:kworker.0 Request processed in 28us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432535.501117:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787432535.501148:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609403520:0@lo:400:kworker.0 00000100:00100000:1.0:1787432535.501201:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432535.501220:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609404032:0@lo:400:kworker.0 00000100:00100000:1.0:1787432535.501239:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432535.501255:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787432535.501260:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609403392:0@lo:400:kworker.0 00000100:00100000:1.0:1787432535.501279:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432535.501294:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609403904:0@lo:400:kworker.0 00000100:00100000:1.0:1787432535.501312:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432535.501612:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609404288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432535.501641:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432535.501672:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609404288 00000100:00100000:2.0:1787432535.501676:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609404288 00000100:00100000:2.0:1787432535.501700:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787432535.501707:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609404288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432535.501732:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432535.501768:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609404288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432535.501774:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1787432535.501807:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f8cdc00 x1874258609404288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787432535.502439:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787432535.502445:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787432535.502448:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432535.502561:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609403520 00000100:00100000:0.0:1787432535.502567:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609403520 00000100:00100000:0.0:1787432535.502604:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787432535.502611:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609403520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432535.502662:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609403520:12345-0@lo:400:kworker.0 Request processed in 51us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432535.502668:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787432535.502710:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609403264:0@lo:400:kworker.0 00010000:00080000:0.0:1787432535.502724:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f85b800 x1874258609403776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432535.502734:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609403776:0@lo:400:kworker.0 00000100:00100000:0.0:1787432535.502747:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609403648:0@lo:400:kworker.0 00010000:00080000:0.0:1787432535.502776:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f85ad80 x1874258609404160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432535.502785:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609404160:0@lo:400:kworker.0 00000100:00100000:0.0:1787432535.502841:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609404032 00000100:00100000:0.0:1787432535.502846:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609404032 00000100:00100000:0.0:1787432535.502884:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609403392 00000100:00100000:0.0:1787432535.502888:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609403392 00000100:00100000:0.0:1787432535.502900:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609403904 00000100:00100000:0.0:1787432535.502903:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609403904 00000100:00100000:0.0:1787432535.502918:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787432535.502925:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609404032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432535.502956:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609404032:12345-0@lo:400:kworker.0 Request processed in 32us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432535.502961:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787432535.502972:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787432535.502977:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609403392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432535.503003:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609403392:12345-0@lo:400:kworker.0 Request processed in 26us (1723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432535.503020:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787432535.503032:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787432535.503038:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609403904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432535.503065:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609403904:12345-0@lo:400:kworker.0 Request processed in 28us (1752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432535.503071:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:0.0:1787432535.503085:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787432535.503088:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787432535.503449:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609404288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432535.503629:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609403136 00000100:00100000:3.0:1787432535.503634:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609403136 00000100:00100000:3.0:1787432535.503682:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787432535.503691:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609403136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432535.503736:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609403136:12345-0@lo:400:kworker.0 Request processed in 47us (3154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432535.503742:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787432535.505042:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609403904:0@lo:400:kworker.0 00000100:00100000:1.0:1787432535.505059:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609403520:0@lo:400:kworker.0 00010000:00080000:1.0:1787432535.505072:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f859c00 x1874258609404032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432535.505083:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609404032:0@lo:400:kworker.0 00000100:00100000:1.0:1787432535.505126:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609403392:0@lo:400:kworker.0 00000100:00100000:0.0:1787432535.505413:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609403136:0@lo:400:kworker.0 00010000:00010000:0.0:1787432536.267369:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787432536.889640:0:12519:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432536.889892:0:12519:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787432537.036464:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609404416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432537.036547:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432537.036724:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609404416 00000100:00100000:3.0:1787432537.036732:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609404416 00000100:00100000:3.0:1787432537.036784:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787432537.036805:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609404416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787432537.036837:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787432537.036883:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609404416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432537.036890:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787432537.036985:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609404416:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787432537.297675:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432537.627253:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432537.627280:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432537.627383:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432537.627426:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432537.627450:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432537.627749:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432537.627766:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588353152 00000100:00100000:2.0:1787432537.627776:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588353152 00000100:00100000:2.0:1787432537.627845:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588353408 00000100:00100000:2.0:1787432537.627848:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588353408 00000100:00100000:2.0:1787432537.627869:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588353280 00000100:00100000:2.0:1787432537.627871:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588353280 00000100:00100000:2.0:1787432537.627888:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 179 00000100:00100000:2.0:1787432537.627898:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2402:x1874258588353152:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432537.627975:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2402:x1874258588353152:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 79us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432537.627983:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 179 00000100:00100000:2.0:1787432537.628003:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 180 00000100:00100000:2.0:1787432537.628010:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588353408:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432537.628036:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588353408:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432537.628042:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 180 00000100:00100000:2.0:1787432537.628054:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 181 00000100:00100000:2.0:1787432537.628060:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588353280:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432537.628095:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588353280:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 35us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432537.628101:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 181 00000100:00100000:2.0:1787432537.628121:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588353024 00000100:00100000:2.0:1787432537.628124:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588353024 00000100:00100000:2.0:1787432537.628146:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 314 00000100:00100000:2.0:1787432537.628152:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405079c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:2402:x1874258588353024:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432537.628190:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405079c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:2402:x1874258588353024:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 38us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432537.628196:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 314 00000100:00080000:0.0:1787432537.628431:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787432537.628436:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432537.628653:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588353664 00000100:00100000:1.0:1787432537.628658:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588353664 00000100:00100000:1.0:1787432537.628694:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 54 00000100:00100000:1.0:1787432537.628701:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830383b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588353664:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432537.628729:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830383b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588353664:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432537.628736:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 54 00000100:00080000:0.0:1787432537.629070:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432537.629082:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588353536 00000100:00100000:0.0:1787432537.629087:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588353536 00000100:00100000:0.0:1787432537.629134:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 182 00000100:00100000:0.0:1787432537.629142:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588353536:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432537.629197:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588353536:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 56us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432537.629205:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 182 00000100:00100000:0.0:1787432537.631603:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432537.631630:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588353792 00000100:00100000:1.0:1787432537.631639:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588353792 00000100:00100000:1.0:1787432537.631696:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 55 00000100:00100000:1.0:1787432537.631706:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588353792:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432537.631763:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588353792:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 59us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432537.631770:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 55 00000100:00080000:1.0:1787432537.631818:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432537.631823:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787432538.332012:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787432539.316559:0:12617:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787432539.316846:0:12617:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787432539.340842:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432540.107461:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432540.107495:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830383bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609404544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432540.107592:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432540.107948:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609404544 00000100:00100000:1.0:1787432540.107962:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609404544 00000100:00100000:1.0:1787432540.108058:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787432540.108069:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609404544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432540.108104:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432540.108160:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609404544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432540.108203:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1787432540.108334:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432540.108604:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609404672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432540.108638:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432540.108722:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432540.108729:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609404800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432540.108765:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432540.108797:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609404800 00000100:00100000:0.0:1787432540.108801:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609404800 00000100:00100000:0.0:1787432540.108830:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787432540.108837:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609404800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432540.108859:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787432540.108914:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609404800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432540.108920:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787432540.108969:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609404800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432540.109306:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609404672 00000100:00100000:2.0:1787432540.109312:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609404672 00000100:00100000:2.0:1787432540.109386:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787432540.109394:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609404672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787432540.109408:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432540.109592:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609404672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 199us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432540.109599:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1787432540.109630:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f85b480 x1874258609404672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432540.109643:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609404672:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787432540.109697:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787432540.110139:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830383bb80 x1874258609404544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432540.110227:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830383bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609404544:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787432540.364488:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432540.622512:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609404928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432540.622605:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432540.622740:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609404928 00000100:00100000:2.0:1787432540.622749:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609404928 00000100:00100000:2.0:1787432540.622812:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787432540.622825:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609404928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432540.622870:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432540.622922:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609404928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432540.622929:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:2.0:1787432540.622971:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f8cdc00 x1874258609404928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432540.622992:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609404928:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787432540.623901:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432540.624100:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609405184:0@lo:400:kworker.0 00000100:00100000:0.0:1787432540.624148:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432540.624212:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609405696:0@lo:400:kworker.0 00000100:00100000:0.0:1787432540.624234:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432540.624255:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787432540.624260:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609405312:0@lo:400:kworker.0 00000100:00100000:0.0:1787432540.624282:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432540.624299:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609405824:0@lo:400:kworker.0 00000100:00100000:0.0:1787432540.624320:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432540.624357:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609405184 00000100:00100000:0.0:1787432540.624364:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609405184 00000100:00100000:0.0:1787432540.624398:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609405696 00000100:00100000:0.0:1787432540.624401:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609405696 00000100:00100000:0.0:1787432540.624440:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609405312 00000100:00100000:0.0:1787432540.624444:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609405312 00000100:00100000:0.0:1787432540.624455:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609405824 00000100:00100000:0.0:1787432540.624457:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609405824 00000100:00100000:0.0:1787432540.624483:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787432540.624490:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609405184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432540.624532:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609405184:12345-0@lo:400:kworker.0 Request processed in 42us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432540.624538:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787432540.624552:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787432540.624557:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609405696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432540.624578:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609405696:12345-0@lo:400:kworker.0 Request processed in 21us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432540.624583:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787432540.624591:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787432540.624596:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609405312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432540.624615:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609405312:12345-0@lo:400:kworker.0 Request processed in 19us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432540.624621:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787432540.624629:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787432540.624634:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609405824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432540.624655:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609405824:12345-0@lo:400:kworker.0 Request processed in 20us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432540.624660:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:0.0:1787432540.624699:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787432540.624702:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787432540.624736:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609405312:0@lo:400:kworker.0 00000100:00100000:0.0:1787432540.624746:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609405824:0@lo:400:kworker.0 00000100:00100000:0.0:1787432540.624753:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609405184:0@lo:400:kworker.0 00010000:00080000:0.0:1787432540.624770:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484348dce00 x1874258609405696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432540.624780:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609405696:0@lo:400:kworker.0 00000100:00100000:3.0:1787432540.624954:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609405440:0@lo:400:kworker.0 00000100:00100000:3.0:1787432540.624985:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432540.625010:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609405952:0@lo:400:kworker.0 00000100:00100000:3.0:1787432540.625029:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432540.625046:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787432540.625051:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609405056:0@lo:400:kworker.0 00000100:00100000:3.0:1787432540.625074:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432540.625092:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609405568:0@lo:400:kworker.0 00000100:00100000:3.0:1787432540.625108:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432540.625118:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609406080:0@lo:400:kworker.0 00000100:00100000:3.0:1787432540.625133:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432540.625208:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609406080 00000100:00100000:1.0:1787432540.625213:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609406080 00000100:00100000:1.0:1787432540.625253:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787432540.625259:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f85b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609406080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432540.625294:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f85b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609406080:12345-0@lo:400:kworker.0 Request processed in 35us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432540.625299:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1787432540.625326:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843489fb80 x1874258609406080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432540.625336:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609406080:0@lo:400:kworker.0 00000100:00080000:3.0:1787432540.625384:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432540.625489:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609405056 00000100:00100000:2.0:1787432540.625492:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609405056 00000100:00100000:2.0:1787432540.625516:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787432540.625522:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840507ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3641:x1874258609405056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432540.625553:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840507ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3641:x1874258609405056:12345-0@lo:400:kworker.0 Request processed in 32us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432540.625559:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1787432540.625589:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609405056:0@lo:400:kworker.0 00000100:00100000:3.0:1787432540.625681:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432540.625690:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609406208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432540.625716:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432540.625985:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609406208 00000100:00100000:2.0:1787432540.625989:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609406208 00000100:00100000:2.0:1787432540.626019:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787432540.626026:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609406208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787432540.626040:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432540.626080:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609406208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432540.626085:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1787432540.626145:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f8cdc00 x1874258609406208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432540.626159:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609406208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432540.630696:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609405440 00000100:00100000:0.0:1787432540.630711:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609405440 00000100:00100000:0.0:1787432540.630993:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787432540.631006:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609405440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432540.631150:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609405440:12345-0@lo:400:kworker.0 Request processed in 145us (6162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432540.631157:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787432540.631244:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609405952 00000100:00100000:0.0:1787432540.631259:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609405952 00000100:00100000:0.0:1787432540.631294:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609405568 00000100:00100000:0.0:1787432540.631297:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609405568 00000100:00100000:0.0:1787432540.631315:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787432540.631321:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609405952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432540.631354:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609405952:12345-0@lo:400:kworker.0 Request processed in 34us (6324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432540.631360:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787432540.631371:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787432540.631377:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f85ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609405568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432540.631402:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f85ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609405568:12345-0@lo:400:kworker.0 Request processed in 26us (6293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432540.631407:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:1.0:1787432540.631584:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432540.631588:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787432540.631818:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609405568:0@lo:400:kworker.0 00000100:00100000:2.0:1787432540.631833:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609405440:0@lo:400:kworker.0 00010000:00080000:2.0:1787432540.631865:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484348dc000 x1874258609405952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432540.631876:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609405952:0@lo:400:kworker.0 00010000:00010000:0.0:1787432541.388517:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787432541.431797:0:12714:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432541.432058:0:12714:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787432542.156912:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609406336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432542.156998:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432542.157193:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609406336 00000100:00100000:3.0:1787432542.157200:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609406336 00000100:00100000:3.0:1787432542.157251:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787432542.157260:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609406336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787432542.157295:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787432542.157355:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609406336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432542.157362:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787432542.158031:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609406336:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787432542.419829:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432542.755362:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432542.755398:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432542.755427:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432542.755450:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432542.755477:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432542.755494:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432542.755517:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432542.755543:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588354048 00000100:00100000:1.0:1787432542.755552:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588354048 00000100:00100000:1.0:1787432542.755624:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588354304 00000100:00100000:1.0:1787432542.755628:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588354304 00000100:00100000:1.0:1787432542.755647:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588354176 00000100:00100000:1.0:1787432542.755650:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588354176 00000100:00100000:1.0:1787432542.755663:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588354432 00000100:00100000:1.0:1787432542.755665:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588354432 00000100:00100000:1.0:1787432542.755693:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 189 00000100:00100000:1.0:1787432542.755704:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2400:x1874258588354048:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432542.755782:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2400:x1874258588354048:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 79us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432542.755790:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 189 00000100:00100000:1.0:1787432542.755806:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 190 00000100:00100000:1.0:1787432542.755813:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588354304:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432542.755826:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588354560 00000100:00100000:0.0:1787432542.755832:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588354560 00000100:00100000:1.0:1787432542.755839:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588354304:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432542.755857:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 190 00000100:00100000:1.0:1787432542.755874:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 191 00000100:00100000:0.0:1787432542.755877:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588354688 00000100:00100000:0.0:1787432542.755881:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588354688 00000100:00100000:1.0:1787432542.755883:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588354176:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432542.755911:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:1.0:1787432542.755915:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588354176:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 33us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432542.755924:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830383b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2399:x1874258588354560:12345-192.168.204.24@tcp:9:kworker.0 00000100:00100000:1.0:1787432542.755926:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 191 00000100:00100000:1.0:1787432542.755944:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 192 00000020:00000080:0.0:1787432542.755947:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ec84 00000100:00100000:1.0:1787432542.755954:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588354432:12345-192.168.204.24@tcp:400:kworker.0 00000100:00080000:0.0:1787432542.755957:0:8431:0:(import.c:65:import_set_state_nolock()) ffff94843f869000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787432542.755982:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588354432:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432542.755989:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 192 00000100:00080000:1.0:1787432542.756017:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432542.756021:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787432542.756034:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432542.756036:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:0.0:1787432542.756078:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787432542.756188:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:1.0:1787432542.756197:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2399:x1874258588354688:12345-192.168.204.24@tcp:9:kworker.0 00000020:00000080:1.0:1787432542.756211:0:8806:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ec8b 00000100:00080000:1.0:1787432542.756219:0:8806:0:(import.c:65:import_set_state_nolock()) ffff94843f86a800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787432542.756237:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830383b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+2:2399:x1874258588354560:12345-192.168.204.24@tcp:9:kworker.0 Request processed in 314us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432542.756244:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 22 00000001:00000004:1.0:1787432542.756252:0:8806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787432542.756267:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588353920 00000100:00100000:0.0:1787432542.756284:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588353920 00000100:00100000:0.0:1787432542.756328:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 316 00000100:00100000:0.0:1787432542.756337:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588353920:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432542.756353:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+2:2399:x1874258588354688:12345-192.168.204.24@tcp:9:kworker.0 Request processed in 155us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432542.756361:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:0.0:1787432542.756367:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588353920:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (887us total) trans 0 rc 0/0 00010000:00010000:1.0:1787432542.756381:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432542.757231:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 316 00010000:00010000:0.0:1787432542.757278:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432543.437552:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787432543.908207:0:12811:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432543.908491:0:12811:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787432544.459626:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432545.227555:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432545.227578:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609406464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787432545.227672:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432545.227742:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609406464 00000100:00100000:3.0:1787432545.227749:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609406464 00000100:00100000:3.0:1787432545.227843:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787432545.227856:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609406464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787432545.227886:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432545.227935:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609406464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432545.227942:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:3.0:1787432545.227990:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405943480 x1874258609406464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432545.228011:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609406464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432545.229036:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432545.229054:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609406592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432545.229144:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787432545.229198:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432545.241588:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609406592 00000100:00100000:3.0:1787432545.241600:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609406592 00000100:00100000:3.0:1787432545.241824:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787432545.241836:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609406592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787432545.241872:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787432545.241977:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609406720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432545.246490:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609406592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4646us (17336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432545.246508:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787432545.251919:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432545.253743:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609406720 00000100:00100000:2.0:1787432545.253756:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609406720 00000100:00100000:2.0:1787432545.253833:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787432545.253845:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830383a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609406720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432545.253871:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432545.253956:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830383a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609406720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432545.253963:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1787432545.254379:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787432545.254444:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948301dbf800 x1874258609406720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432545.254472:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609406720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432545.254522:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609406592:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787432545.483704:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432545.739373:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f8cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609406848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432545.739460:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432545.739549:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609406848 00000100:00100000:2.0:1787432545.739558:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609406848 00000100:00100000:2.0:1787432545.739616:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787432545.739639:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303915f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609406848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432545.739811:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432545.740136:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303915f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609406848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 499us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432545.740145:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1787432545.740188:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432545.745136:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830383aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609407104:0@lo:400:kworker.0 00000100:00100000:2.0:1787432545.745242:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432545.745316:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432545.745324:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830383a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609406976:0@lo:400:kworker.0 00000100:00100000:2.0:1787432545.745357:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432545.745399:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609407104 00000100:00100000:2.0:1787432545.745407:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609407104 00000100:00100000:2.0:1787432545.745459:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787432545.745468:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609407104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432545.745525:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609407104:12345-0@lo:400:kworker.0 Request processed in 57us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432545.745532:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787432545.745557:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609406976 00000100:00100000:2.0:1787432545.745560:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609406976 00000100:00100000:2.0:1787432545.745593:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1787432545.745600:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840507a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3642:x1874258609406976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432545.745640:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840507a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3642:x1874258609406976:12345-0@lo:400:kworker.0 Request processed in 41us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432545.745647:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00010000:00080000:0.0:1787432545.745874:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f8cdc00 x1874258609406848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432545.745902:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f8cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609406848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432545.745948:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609407360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432545.746762:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432545.746815:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432545.746824:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830383b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609407232:0@lo:400:kworker.0 00000100:00100000:0.0:1787432545.747056:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432545.747100:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609407232 00000100:00100000:0.0:1787432545.747108:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609407232 00000100:00100000:0.0:1787432545.747155:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787432545.747185:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609407232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432545.747234:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609407232:12345-0@lo:400:kworker.0 Request processed in 70us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432545.747241:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787432545.747281:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830383b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609407232:0@lo:400:kworker.0 00000100:00100000:2.0:1787432545.747525:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609407360 00000100:00100000:2.0:1787432545.747531:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609407360 00000100:00100000:2.0:1787432545.747636:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787432545.747645:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609407360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787432545.747676:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432545.747721:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609407360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432545.747729:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787432545.747772:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830383a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609406976:0@lo:400:kworker.0 00000100:00100000:2.0:1787432545.747788:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830383aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609407104:0@lo:400:kworker.0 00000100:00100000:0.0:1787432545.748768:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609407488:0@lo:400:kworker.0 00000100:00100000:0.0:1787432545.748819:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432545.748860:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609408000:0@lo:400:kworker.0 00000100:00100000:0.0:1787432545.748885:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432545.748907:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432545.748913:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609407616:0@lo:400:kworker.0 00000100:00100000:0.0:1787432545.748935:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432545.748961:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609407488 00000100:00100000:0.0:1787432545.748966:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609407488 00000100:00100000:2.0:1787432545.749222:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609407872:0@lo:400:kworker.0 00000100:00100000:2.0:1787432545.749253:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787432545.749288:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948433652680 x1874258609407360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432545.749308:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609407360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432545.749324:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432545.749329:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609407744:0@lo:400:kworker.0 00000100:00100000:2.0:1787432545.749352:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432545.749754:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787432545.749766:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609407488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432545.749820:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609407488:12345-0@lo:400:kworker.0 Request processed in 58us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432545.751594:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787432545.751652:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609408000 00000100:00100000:0.0:1787432545.751661:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609408000 00000100:00080000:1.0:1787432545.758934:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432545.758946:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432545.759796:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609407616 00000100:00100000:1.0:1787432545.759811:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609407616 00000100:00100000:1.0:1787432545.760049:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609407872 00000100:00100000:1.0:1787432545.760054:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609407872 00000100:00100000:1.0:1787432545.760073:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609407744 00000100:00100000:1.0:1787432545.760077:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609407744 00000100:00100000:1.0:1787432545.760098:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787432545.760107:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609407616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432545.760226:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609407616:12345-0@lo:400:kworker.0 Request processed in 119us (11289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432545.760234:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787432545.760251:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787432545.760258:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609407872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432545.760298:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609407872:12345-0@lo:400:kworker.0 Request processed in 40us (11044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432545.760322:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787432545.760335:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787432545.760342:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609407744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432545.760374:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609407744:12345-0@lo:400:kworker.0 Request processed in 33us (11021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432545.760380:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00080000:3.0:1787432545.760559:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843489e680 x1874258609407744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432545.760575:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609407744:0@lo:400:kworker.0 00000100:00100000:3.0:1787432545.760587:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609407872:0@lo:400:kworker.0 00000100:00100000:3.0:1787432545.765333:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609407616:0@lo:400:kworker.0 00000100:00100000:3.0:1787432545.765353:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609407488:0@lo:400:kworker.0 00000100:00100000:0.0:1787432545.767596:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787432545.767615:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609408000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432545.767746:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609408000:12345-0@lo:400:kworker.0 Request processed in 138us (18859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432545.767755:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:2.0:1787432545.768462:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787432545.768489:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787432545.768578:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843489f480 x1874258609408000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432545.768595:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609408000:0@lo:400:kworker.0 00000020:00000004:3.0:1787432546.257960:0:12909:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432546.258244:0:12909:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787432546.512313:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432547.275754:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432547.275778:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609408128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432547.275864:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432547.275955:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609408128 00000100:00100000:0.0:1787432547.275962:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609408128 00000100:00100000:0.0:1787432547.276015:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787432547.276025:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609408128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432547.276059:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432547.276104:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609408128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432547.276110:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787432547.276157:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609408128:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787432547.532045:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432547.866746:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432547.866783:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432547.866834:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432547.866862:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432547.866888:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432547.866972:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588354816 00000100:00100000:2.0:1787432547.866984:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588354816 00000100:00100000:2.0:1787432547.867049:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 318 00000100:00100000:2.0:1787432547.867061:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840507a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:2403:x1874258588354816:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432547.867129:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840507a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:2403:x1874258588354816:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 71us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432547.867137:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 318 00000100:00100000:0.0:1787432547.867939:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588354944 00000100:00100000:0.0:1787432547.867961:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588354944 00000100:00100000:0.0:1787432547.868019:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588355200 00000100:00100000:0.0:1787432547.868023:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588355200 00000100:00100000:0.0:1787432547.868038:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588355072 00000100:00100000:0.0:1787432547.868040:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588355072 00000100:00100000:0.0:1787432547.868051:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588355328 00000100:00100000:0.0:1787432547.868053:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588355328 00000100:00100000:0.0:1787432547.868070:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 199 00000100:00100000:0.0:1787432547.868078:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588354944:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432547.868124:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588354944:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 47us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432547.868131:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 199 00000100:00100000:0.0:1787432547.868147:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 200 00000100:00100000:0.0:1787432547.868154:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830383ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2403:x1874258588355200:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432547.868206:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830383ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2403:x1874258588355200:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 52us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432547.868213:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 200 00000100:00100000:0.0:1787432547.868225:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 201 00000100:00100000:0.0:1787432547.868231:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588355072:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432547.868256:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588355072:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432547.868263:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 201 00000100:00100000:0.0:1787432547.868284:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 202 00000100:00100000:0.0:1787432547.868292:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830383aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2403:x1874258588355328:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432547.868316:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830383aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2403:x1874258588355328:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432547.868331:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 202 00000100:00080000:2.0:1787432547.868408:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787432547.868412:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787432548.557431:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787432548.815080:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0f5e99cc-19dc-4ba3-b74b-91816a9b078c 00000020:00000080:0.0:1787432548.815092:0:8425:0:(genops.c:885:class_export_put()) final put ffff94843f869800/0f5e99cc-19dc-4ba3-b74b-91816a9b078c 00000020:00000080:2.0:1787432548.817864:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff94843f869800/0f5e99cc-19dc-4ba3-b74b-91816a9b078c for lustre-OST0000 00000020:00000080:2.0:1787432548.817929:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94843f869000 for lustre-OST0000 00000001:00100000:0.0:1787432548.818800:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0f5e99cc-19dc-4ba3-b74b-91816a9b078c 00000020:00000080:0.0:1787432548.818806:0:9509:0:(genops.c:885:class_export_put()) final put ffff94843f86f800/0f5e99cc-19dc-4ba3-b74b-91816a9b078c 00000020:00000080:3.0:1787432548.819775:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843f86f800/0f5e99cc-19dc-4ba3-b74b-91816a9b078c for lustre-OST0001 00000020:00000080:3.0:1787432548.819838:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94843f86a800 for lustre-OST0001 00010000:00010000:3.0:1787432549.580468:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432550.347475:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432550.347510:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609408256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432550.347608:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432550.347675:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609408256 00000100:00100000:3.0:1787432550.347683:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609408256 00000100:00100000:3.0:1787432550.347735:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787432550.347746:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609408256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432550.347797:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432550.347843:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609408256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432550.347850:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1787432550.347871:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787432550.347904:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948301dbd180 x1874258609408256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432550.347923:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609408256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432550.348933:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609408512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432550.348991:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432550.349331:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432550.349341:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609408384:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432550.349376:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432550.349417:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609408384 00000100:00100000:1.0:1787432550.349423:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609408384 00000100:00100000:1.0:1787432550.349466:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787432550.349473:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830383a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609408384:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432550.349620:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609408512 00000100:00100000:0.0:1787432550.349625:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609408512 00000100:00100000:0.0:1787432550.349660:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787432550.349667:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609408512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432550.349694:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787432550.349741:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609408512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432550.349749:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00002000:00000024:1.0:1787432550.350018:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432550.350069:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830383a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609408384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 595us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432550.350075:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1787432550.350093:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432550.350961:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609408512:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1787432550.351085:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948301dbd180 x1874258609408384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432550.351100:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609408384:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1787432550.544391:0:13053:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787432550.605384:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432550.861203:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609408640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432550.861290:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432550.861403:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609408640 00000100:00100000:0.0:1787432550.861412:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609408640 00000100:00100000:0.0:1787432550.861479:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787432550.861492:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609408640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787432550.861538:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432550.861603:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609408640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432550.861611:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1787432550.861635:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787432550.861673:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484348dc000 x1874258609408640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432550.861693:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609408640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432550.862634:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830383b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609408768:0@lo:400:kworker.0 00000100:00100000:3.0:1787432550.862691:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432550.862736:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609409280:0@lo:400:kworker.0 00000100:00100000:3.0:1787432550.862765:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432550.862783:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609409792:0@lo:400:kworker.0 00000100:00100000:3.0:1787432550.862805:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432550.862833:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787432550.862838:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830383bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609408896:0@lo:400:kworker.0 00000100:00100000:3.0:1787432550.862856:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432550.862870:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609409408:0@lo:400:kworker.0 00000100:00100000:3.0:1787432550.862889:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432550.862916:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609409792 00000100:00100000:3.0:1787432550.862921:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609409792 00000100:00100000:3.0:1787432550.862965:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787432550.862974:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609409792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432550.863017:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609409792:12345-0@lo:400:kworker.0 Request processed in 44us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432550.863031:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787432550.863055:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609409280 00000100:00100000:3.0:1787432550.863059:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609409280 00000100:00100000:3.0:1787432550.863086:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609408896 00000100:00100000:3.0:1787432550.863089:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609408896 00000100:00100000:3.0:1787432550.863107:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609409408 00000100:00100000:3.0:1787432550.863109:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609409408 00000100:00100000:3.0:1787432550.863125:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787432550.863132:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609409280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432550.863197:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609409280:12345-0@lo:400:kworker.0 Request processed in 65us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432550.863204:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787432550.863228:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787432550.863235:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609408896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432550.863263:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609408896:12345-0@lo:400:kworker.0 Request processed in 29us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432550.863268:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787432550.863279:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787432550.863285:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609409408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432550.863310:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609409408:12345-0@lo:400:kworker.0 Request processed in 26us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432550.863316:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787432550.863355:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830383bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609408896:0@lo:400:kworker.0 00010000:00080000:3.0:1787432550.863368:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303b3b480 x1874258609409408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432550.863379:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609409408:0@lo:400:kworker.0 00000100:00100000:3.0:1787432550.863399:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609409280:0@lo:400:kworker.0 00010000:00080000:3.0:1787432550.863408:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303b39c00 x1874258609409792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432550.863416:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609409792:0@lo:400:kworker.0 00000100:00100000:0.0:1787432550.863810:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609409920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432550.863844:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787432550.863897:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787432550.863903:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787432550.863906:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432550.863915:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609409024:0@lo:400:kworker.0 00000100:00100000:0.0:1787432550.863942:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432550.863961:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609409536:0@lo:400:kworker.0 00000100:00100000:0.0:1787432550.863979:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432550.863996:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787432550.864002:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609409152:0@lo:400:kworker.0 00000100:00100000:0.0:1787432550.864027:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432550.864046:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609409664:0@lo:400:kworker.0 00000100:00100000:0.0:1787432550.864066:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432550.864089:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609409152 00000100:00100000:0.0:1787432550.864094:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609409152 00000100:00100000:0.0:1787432550.864126:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787432550.864134:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609409152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432550.864192:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609409152:12345-0@lo:400:kworker.0 Request processed in 59us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432550.864209:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787432550.864246:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609409024 00000100:00100000:0.0:1787432550.864250:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609409024 00000100:00100000:0.0:1787432550.864270:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609409536 00000100:00100000:0.0:1787432550.864273:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609409536 00000100:00100000:0.0:1787432550.864294:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609409664 00000100:00100000:0.0:1787432550.864296:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609409664 00000100:00100000:0.0:1787432550.864310:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787432550.864316:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609409024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432550.864347:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609409024:12345-0@lo:400:kworker.0 Request processed in 32us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432550.864354:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787432550.864366:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787432550.864372:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609409536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432550.864399:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609409536:12345-0@lo:400:kworker.0 Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432550.864405:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787432550.864416:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787432550.864423:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609409664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432550.864449:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609409664:12345-0@lo:400:kworker.0 Request processed in 26us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432550.864454:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:0.0:1787432550.864473:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787432550.864475:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432550.864493:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609409152:0@lo:400:kworker.0 00010000:00080000:0.0:1787432550.864504:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303b3ad80 x1874258609409664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432550.864531:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609409664:0@lo:400:kworker.0 00000100:00100000:0.0:1787432550.864553:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609409024:0@lo:400:kworker.0 00000100:00100000:0.0:1787432550.864563:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609409536:0@lo:400:kworker.0 00000100:00100000:1.0:1787432550.864677:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609408768 00000100:00100000:1.0:1787432550.864683:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609408768 00000100:00100000:1.0:1787432550.864716:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787432550.864722:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609408768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432550.864755:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609408768:12345-0@lo:400:kworker.0 Request processed in 35us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432550.864761:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1787432550.864989:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609409920 00000100:00100000:2.0:1787432550.865000:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609409920 00000100:00100000:2.0:1787432550.865037:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787432550.865043:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609409920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432550.865058:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432550.865095:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609409920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432550.865100:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1787432550.865126:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948433651f80 x1874258609409920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432550.865141:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609409920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432550.868450:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830383b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609408768:0@lo:400:kworker.0 00010000:00010000:0.0:1787432551.644109:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432552.399360:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609410048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432552.399454:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432552.399879:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609410048 00000100:00100000:2.0:1787432552.399889:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609410048 00000100:00100000:2.0:1787432552.399944:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787432552.399955:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609410048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787432552.399997:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787432552.400051:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609410048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432552.400058:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787432552.401524:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609410048:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787432552.651511:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432552.986731:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432552.986777:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432552.986820:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432552.986842:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432552.986866:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432552.986894:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588355456 00000100:00100000:1.0:1787432552.986903:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588355456 00000100:00100000:1.0:1787432552.986951:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 320 00000100:00100000:1.0:1787432552.986963:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:2401:x1874258588355456:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432552.987034:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:2401:x1874258588355456:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 72us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432552.987042:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 320 00000100:00100000:1.0:1787432552.987091:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588355584 00000100:00100000:1.0:1787432552.987095:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588355584 00000100:00100000:1.0:1787432552.987132:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588355840 00000100:00100000:1.0:1787432552.987135:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588355840 00000100:00100000:1.0:1787432552.987149:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588355712 00000100:00100000:1.0:1787432552.987152:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588355712 00000100:00100000:2.0:1787432552.987331:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588355968 00000100:00100000:2.0:1787432552.987337:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588355968 00000100:00100000:2.0:1787432552.987363:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 209 00000100:00100000:2.0:1787432552.987371:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2401:x1874258588355584:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432552.987405:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2401:x1874258588355584:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 36us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432552.987411:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 209 00000100:00100000:2.0:1787432552.987424:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 210 00000100:00100000:2.0:1787432552.987444:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588355840:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432552.987472:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588355840:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432552.987493:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 210 00000100:00100000:2.0:1787432552.987505:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 211 00000100:00100000:2.0:1787432552.987513:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588355968:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432552.987542:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588355968:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432552.987548:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 211 00000100:00100000:2.0:1787432552.987558:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 212 00000100:00100000:2.0:1787432552.987626:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588355712:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432552.987662:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588355712:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 98us (819us total) trans 0 rc 0/0 00000100:00080000:0.0:1787432552.993752:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787432552.993762:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432552.995380:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 212 00010000:00010000:1.0:1787432553.675965:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787432554.373062:0:13201:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb3f933e0 20000000:00000080:1.0:1787432554.373087:0:13201:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9483037cbc00 uarg=0000000000000000 20000000:01000000:1.0:1787432554.373133:0:13201:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787432554.373139:0:13201:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787432554.373149:0:13201:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787432554.386945:0:13202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1787432554.391508:0:13201:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787432554.411055:0:13201:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787432554.411086:0:13201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948400030c00/0xca72b3b33563ec92 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.411107:0:13201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948303012000/0xca72b3b33563ec22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c7a expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.411117:0:13201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484013fdc00/0xca72b3b33563ec30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ec29 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.411123:0:13201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484013fce00/0xca72b3b33563ec3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ec37 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.411129:0:13201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948303013600/0xca72b3b33563ec4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ec45 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.412567:0:13201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948303012400/0xca72b3b33563ec5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ec53 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.412577:0:13201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948303012600/0xca72b3b33563ec6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cb9 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.412585:0:13201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948400030c00/0xca72b3b33563ec92 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.412650:0:13201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948303012600/0xca72b3b33563ec6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cb9 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.412666:0:13201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948303012600/0xca72b3b33563ec6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cb9 expref: 12 pid: 6507 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432554.412683:0:13201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948302765180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1874258609410176:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432554.414805:0:13201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948303012400/0xca72b3b33563ec5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563ec53 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.414822:0:13201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948303012400/0xca72b3b33563ec5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563ec53 expref: 23 pid: 6508 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432554.414836:0:13201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b38e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1874258609410304:0@lo:104: 00000100:00100000:1.0:1787432554.414899:0:13201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787432554.414948:0:13201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948303013600/0xca72b3b33563ec4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563ec45 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.414957:0:13201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948303013600/0xca72b3b33563ec4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563ec45 expref: 23 pid: 6507 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432554.414966:0:13201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b38a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1874258609410432:0@lo:104: 00000100:00100000:1.0:1787432554.414988:0:13201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787432554.415011:0:13201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484013fce00/0xca72b3b33563ec3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563ec37 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415020:0:13201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9484013fce00/0xca72b3b33563ec3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563ec37 expref: 23 pid: 6506 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432554.415027:0:13201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1874258609410560:0@lo:104: 00000100:00100000:1.0:1787432554.415046:0:13201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432554.415082:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609410304 00000100:00100000:1.0:1787432554.415090:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609410304 00000100:00100000:1.0:1787432554.415132:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609410432 00000100:00100000:1.0:1787432554.415135:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609410432 00000100:00100000:1.0:1787432554.415145:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609410560 00000100:00100000:1.0:1787432554.415147:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609410560 00000100:00100000:1.0:1787432554.415199:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787432554.415206:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+5:13201:x1874258609410304:12345-0@lo:104: 00010000:00010000:1.0:1787432554.415218:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948303012800/0xca72b3b33563ec53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ec5a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415261:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787432554.415266:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+5:13201:x1874258609410304:12345-0@lo:104: Request processed in 60us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432554.415273:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787432554.415289:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787432554.415296:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:13201:x1874258609410432:12345-0@lo:104: 00010000:00010000:1.0:1787432554.415303:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ec45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ec4c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415335:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787432554.415339:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:13201:x1874258609410432:12345-0@lo:104: Request processed in 45us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432554.415345:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787432554.415356:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787432554.415377:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:13201:x1874258609410560:12345-0@lo:104: 00010000:00010000:1.0:1787432554.415384:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948303013000/0xca72b3b33563ec37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ec3e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415416:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787432554.415420:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:13201:x1874258609410560:12345-0@lo:104: Request processed in 60us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432554.415426:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1787432554.415442:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787432554.415462:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948303012800/0xca72b3b33563ec53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ec5a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415469:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303012800 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432554.415473:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948303012800/0xca72b3b33563ec53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563ec5a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415481:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948303012800/0xca72b3b33563ec53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563ec5a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432554.415488:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948303012800/0xca72b3b33563ec53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563ec5a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432554.415493:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787432554.415521:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948303012800/0xca72b3b33563ec53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ec5a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415528:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432554.415553:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948303012800/0xca72b3b33563ec53 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ec5a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415561:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948303012800/0xca72b3b33563ec53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ec5a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415576:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432554.415579:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ec45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ec4c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415584:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948401683000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432554.415588:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ec45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563ec4c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415748:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ec45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563ec4c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432554.415755:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ec45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563ec4c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432554.415761:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787432554.415776:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ec45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ec4c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415782:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432554.415797:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ec45 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ec4c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415804:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948401683000/0xca72b3b33563ec45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ec4c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415815:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432554.415818:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948303013000/0xca72b3b33563ec37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ec3e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415823:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432554.415826:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948303013000/0xca72b3b33563ec37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563ec3e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415833:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948303013000/0xca72b3b33563ec37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563ec3e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432554.415839:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948303013000/0xca72b3b33563ec37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563ec3e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432554.415851:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787432554.415865:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948303013000/0xca72b3b33563ec37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ec3e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415872:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432554.415879:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948303013000/0xca72b3b33563ec37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ec3e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415885:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948303013000/0xca72b3b33563ec37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ec3e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415894:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432554.415895:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432554.415897:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432554.415922:0:13201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484013fdc00/0xca72b3b33563ec30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563ec29 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.415932:0:13201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9484013fdc00/0xca72b3b33563ec30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563ec29 expref: 23 pid: 6506 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432554.415942:0:13201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b3ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1874258609411072:0@lo:104: 00000100:00100000:1.0:1787432554.415971:0:13201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432554.415998:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609411072 00000100:00100000:1.0:1787432554.416002:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609411072 00000100:00100000:1.0:1787432554.416024:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787432554.416032:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:13201:x1874258609411072:12345-0@lo:104: 00010000:00010000:1.0:1787432554.416040:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33563ec29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ec30 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.416085:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787432554.416090:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:13201:x1874258609411072:12345-0@lo:104: Request processed in 60us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432554.416097:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1787432554.416112:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432554.416116:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33563ec29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ec30 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.416123:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85f800 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432554.416126:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33563ec29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563ec30 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.416133:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33563ec29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563ec30 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432554.416139:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33563ec29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563ec30 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432554.416144:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787432554.416157:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33563ec29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ec30 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.416185:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432554.416193:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33563ec29 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ec30 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.416199:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff94843f85f800/0xca72b3b33563ec29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ec30 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.416222:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432554.416223:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432554.416225:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432554.416245:0:13201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948303012000/0xca72b3b33563ec22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c7a expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.416254:0:13201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948303012000/0xca72b3b33563ec22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c7a expref: 12 pid: 6508 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432554.416263:0:13201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b3aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1874258609411328:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432554.416306:0:13201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112cf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432554.416329:0:13201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b38e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1874258609410304:0@lo:104: 00000100:00100000:1.0:1787432554.416338:0:13201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b38a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1874258609410432:0@lo:104: 00000100:00100000:1.0:1787432554.416346:0:13201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1874258609410560:0@lo:104: 00000100:00100000:1.0:1787432554.416352:0:13201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b3ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1874258609411072:0@lo:104: 00010000:00010000:0.0:1787432554.416744:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432554.416772:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609411200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432554.416809:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432554.416843:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432554.416849:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609410688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432554.416868:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432554.417382:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609411200 00000100:00100000:0.0:1787432554.417389:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609411200 00010000:00010000:0.0:1787432554.417420:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484013fdc00/0xca72b3b33563ec30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ec29 expref: 24 pid: 6506 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432554.417459:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609410688 00000100:00100000:0.0:1787432554.417472:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609410688 00010000:00010000:0.0:1787432554.417487:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948303012400/0xca72b3b33563ec5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ec53 expref: 25 pid: 6508 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432554.417509:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787432554.417517:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+25:3641:x1874258609411200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432554.417529:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432554.417535:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484013fdc00/0xca72b3b33563ec30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ec29 expref: 25 pid: 6506 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.417546:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484013fdc00/0xca72b3b33563ec30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563ec29 expref: 25 pid: 6506 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.417561:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fdc00/0xca72b3b33563ec30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563ec29 expref: 25 pid: 6506 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.417576:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432554.417632:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3641:x1874258609411200:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432554.417639:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787432554.417657:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787432554.417664:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:3641:x1874258609410688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432554.417671:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432554.417675:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948303012400/0xca72b3b33563ec5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ec53 expref: 23 pid: 6508 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.417683:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948303012400/0xca72b3b33563ec5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563ec53 expref: 23 pid: 6508 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.417705:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303012400/0xca72b3b33563ec5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563ec53 expref: 23 pid: 6508 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.417720:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432554.417746:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:3641:x1874258609410688:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432554.417752:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787432554.417774:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609410944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432554.417801:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432554.417829:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432554.417835:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609410816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432554.417854:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432554.417890:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609410944 00000100:00100000:0.0:1787432554.417894:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609410944 00010000:00010000:0.0:1787432554.417909:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484013fce00/0xca72b3b33563ec3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ec37 expref: 22 pid: 6506 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432554.417920:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609410816 00000100:00100000:0.0:1787432554.417922:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609410816 00010000:00010000:0.0:1787432554.417930:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948303013600/0xca72b3b33563ec4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ec45 expref: 23 pid: 6507 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432554.417940:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787432554.417945:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:3644:x1874258609410944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432554.417953:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432554.417957:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484013fce00/0xca72b3b33563ec3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ec37 expref: 23 pid: 6506 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.417964:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484013fce00/0xca72b3b33563ec3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563ec37 expref: 23 pid: 6506 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.417984:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fce00/0xca72b3b33563ec3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563ec37 expref: 23 pid: 6506 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.417995:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432554.418023:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:3644:x1874258609410944:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432554.418029:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787432554.418041:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787432554.418047:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:3644:x1874258609410816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432554.418054:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432554.418058:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948303013600/0xca72b3b33563ec4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ec45 expref: 21 pid: 6507 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.418066:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948303013600/0xca72b3b33563ec4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563ec45 expref: 21 pid: 6507 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.418075:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303013600/0xca72b3b33563ec4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563ec45 expref: 21 pid: 6507 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432554.418083:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432554.418103:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:3644:x1874258609410816:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432554.418108:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787432554.418133:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609410816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432554.418139:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609410944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432554.418652:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609410688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432554.418673:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609411200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432554.421131:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432554.426850:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432554.426939:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432554.426965:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588356096 00000100:00100000:3.0:1787432554.426973:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588356096 00010000:00010000:3.0:1787432554.427013:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948303012600/0xca72b3b33563ec6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cb9 expref: 13 pid: 6507 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432554.427060:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588356224 00000100:00100000:3.0:1787432554.427063:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588356224 00010000:00010000:3.0:1787432554.427077:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948303012000/0xca72b3b33563ec22 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c7a expref: 14 pid: 6508 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432554.427099:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 44 00000100:00100000:3.0:1787432554.427109:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a40dc378-0ae8-4eb1-a992-02a683490593+14:2403:x1874258588356096:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432554.427123:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432554.427129:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948303012600/0xca72b3b33563ec6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cb9 expref: 14 pid: 6507 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432554.427150:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948303012600/0xca72b3b33563ec6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cb9 expref: 14 pid: 6507 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432554.427211:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432554.427378:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303012600/0xca72b3b33563ec6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cb9 expref: 14 pid: 6507 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432554.427392:0:13201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948302765180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1874258609410176:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432554.427403:0:13201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b3aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13201:1874258609411328:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432554.427436:0:13201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948400030c00/0xca72b3b33563ec92 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432554.427550:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 45 00000100:00100000:2.0:1787432554.427562:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94841223d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a40dc378-0ae8-4eb1-a992-02a683490593+13:2403:x1874258588356224:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432554.427572:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432554.427577:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948303012000/0xca72b3b33563ec22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c7a expref: 13 pid: 6508 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432554.427586:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948303012000/0xca72b3b33563ec22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c7a expref: 13 pid: 6508 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432554.427596:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303012000/0xca72b3b33563ec22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c7a expref: 13 pid: 6508 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432554.427618:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948400030c00/0xca72b3b33563ec92 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432554.427626:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948400030c00/0xca72b3b33563ec92 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432554.427640:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948400030c00/0xca72b3b33563ec92 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432554.427647:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948400030c00/0xca72b3b33563ec92 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432554.427655:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948400030c00/0xca72b3b33563ec92 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432554.427661:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948400030c00/0xca72b3b33563ec92 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432554.427667:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030c00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432554.427671:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948400030c00/0xca72b3b33563ec92 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432554.427678:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948400030c00/0xca72b3b33563ec92 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432554.427700:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948400030c00/0xca72b3b33563ec92 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432554.427709:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432554.427760:0:13201:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948400030c00/0xca72b3b33563ec92 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.427777:0:13201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948400030c00/0xca72b3b33563ec92 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432554.427783:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948400030c00/0xca72b3b33563ec92 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432554.430293:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a40dc378-0ae8-4eb1-a992-02a683490593+12:2403:x1874258588356096:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 3171us (3438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432554.430309:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 44 00000100:00100000:2.0:1787432554.430514:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94841223d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a40dc378-0ae8-4eb1-a992-02a683490593+11:2403:x1874258588356224:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 2954us (3573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432554.430538:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 45 00010000:00010000:1.0:1787432554.699378:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432555.467515:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432555.467540:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609411456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432555.467621:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432555.467724:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609411456 00000100:00100000:3.0:1787432555.467733:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609411456 00000100:00100000:3.0:1787432555.467799:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787432555.467810:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609411456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432555.467840:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432555.467891:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609411456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432555.467898:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1787432555.467941:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843489d180 x1874258609411456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432555.467959:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609411456:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787432555.468022:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432555.468378:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609411584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432555.468411:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432555.468486:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609411584 00000100:00100000:1.0:1787432555.468492:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609411584 00000100:00100000:1.0:1787432555.468532:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787432555.468540:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609411584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787432555.468566:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787432555.468606:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609411584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432555.468612:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787432555.468678:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609411584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432555.474505:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609411712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787432555.474590:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432555.474737:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609411712 00000100:00100000:2.0:1787432555.474747:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609411712 00000100:00080000:1.0:1787432555.475311:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432555.475420:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787432555.475443:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609411712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787432555.475470:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432555.475545:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609411712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432555.475552:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1787432555.476107:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948433653b80 x1874258609411712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432555.476143:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609411712:0@lo:13:osp-pre-0-1.0 10000000:01000000:1.0:1787432555.661612:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787432555.661619:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948435bcb800 from 7 10000000:01000000:1.0:1787432555.661624:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787432555.662142:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303851c00/0xca72b3b33563ec99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432555.662199:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948303851c00/0xca72b3b33563ec99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432555.662213:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948303851c00/0xca72b3b33563ec99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432555.662370:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609411840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787432555.662850:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432555.662905:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358a9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787432555.663568:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609411840 00000100:00100000:0.0:1787432555.663578:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609411840 00000100:00100000:0.0:1787432555.663840:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787432555.663852:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609411840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432555.663869:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432555.663887:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948400030c00/0xca72b3b33563eca0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ec99 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432555.663914:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948400030c00/0xca72b3b33563eca0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ec99 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432555.663925:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948400030c00/0xca72b3b33563eca0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ec99 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432555.663933:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948400030c00, rc 0) 00000100:00100000:0.0:1787432555.663988:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609411840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432555.663995:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787432555.664984:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609411840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432555.665007:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948303851c00/0xca72b3b33563ec99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eca0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432555.665018:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948303851c00/0xca72b3b33563ec99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563eca0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432555.665098:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609411968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432555.665157:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432555.665210:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358a9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787432555.665586:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609411968 00000100:00100000:0.0:1787432555.665604:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609411968 00000100:00100000:0.0:1787432555.666553:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787432555.666570:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609411968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432555.666752:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609411968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432555.666759:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787432555.666859:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609411968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432555.666902:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609412096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432555.666942:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432555.673096:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358a9480 going to sleep for 11 seconds 00000100:00100000:2.0:1787432555.673934:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609412096 00000100:00100000:2.0:1787432555.673944:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609412096 00000100:00100000:2.0:1787432555.673994:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787432555.674004:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609412096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432555.674196:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609412096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 192us (7252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432555.674204:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787432555.674338:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609412096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787432555.675640:0:13222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787432555.676337:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787432555.676363:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432555.676375:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303851c00/0xca72b3b33563ec99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eca0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432555.676387:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948303851c00/0xca72b3b33563ec99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eca0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432555.676398:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787432555.676401:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948435a21000 from 7 10000000:01000000:2.0:1787432555.676404:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787432555.676474:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b33563eca7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432555.676482:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b33563eca7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432555.676493:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b33563eca7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432555.676517:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609412224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787432555.676585:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432555.676642:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037eac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432555.676922:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609412224 00000100:00100000:1.0:1787432555.676930:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609412224 00000100:00100000:1.0:1787432555.676968:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787432555.676977:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609412224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432555.676989:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432555.677000:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303850200/0xca72b3b33563ecae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563eca7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432555.677023:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303850200/0xca72b3b33563ecae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563eca7 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432555.677032:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303850200/0xca72b3b33563ecae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563eca7 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432555.677042:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850200, rc 0) 00000100:00100000:1.0:1787432555.677080:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609412224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432555.677086:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787432555.677267:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609412224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432555.677282:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b33563eca7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ecae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432555.677305:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b33563eca7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ecae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432555.677373:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609412352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432555.677402:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432555.677439:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037eac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432555.677721:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609412352 00000100:00100000:1.0:1787432555.677726:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609412352 00000100:00100000:1.0:1787432555.677748:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787432555.677755:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609412352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432555.677865:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609412352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432555.677872:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787432555.678140:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609412352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432555.678195:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609412480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432555.678362:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432555.678389:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037eac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432555.678469:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609412480 00000100:00100000:1.0:1787432555.678474:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609412480 00000100:00100000:1.0:1787432555.678496:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787432555.678502:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609412480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432555.678587:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609412480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432555.678843:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609412480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787432555.679889:0:13223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787432555.679968:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787432555.679989:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432555.680000:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b33563eca7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ecae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432555.680011:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b33563eca7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ecae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432555.680022:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787432555.680025:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94842dfc5000 from 7 10000000:01000000:2.0:1787432555.680028:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787432555.680061:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b33563ecb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432555.680069:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b33563ecb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432555.680079:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b33563ecb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432555.680098:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609412608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787432555.680360:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787432555.680997:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432555.681070:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037eab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432555.681110:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609412608 00000100:00100000:0.0:1787432555.681534:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609412608 00000100:00100000:0.0:1787432555.681619:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1787432555.681630:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609412608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432555.681647:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432555.681840:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948400030200/0xca72b3b33563ecbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ecb5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432555.681870:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948400030200/0xca72b3b33563ecbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ecb5 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432555.681881:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948400030200/0xca72b3b33563ecbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ecb5 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432555.681891:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948400030200, rc 0) 00000100:00100000:0.0:1787432555.681951:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609412608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 322us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432555.681957:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787432555.682038:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609412608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432555.682055:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b33563ecb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ecbc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432555.682064:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b33563ecb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ecbc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432555.682150:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609412736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432555.682202:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432555.682935:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037eab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432555.682988:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609412736 00000100:00100000:1.0:1787432555.682994:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609412736 00000100:00100000:3.0:1787432555.683038:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1787432555.683049:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609412736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432555.683207:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609412736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432555.683232:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787432555.683410:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609412736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432555.683468:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609412864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432555.683512:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432555.683538:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037eab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432555.683805:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609412864 00000100:00100000:3.0:1787432555.683810:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609412864 00000100:00100000:3.0:1787432555.683833:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1787432555.683840:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609412864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432555.683934:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609412864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432555.683941:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787432555.684076:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609412864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787432555.697873:0:13224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787432555.698084:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787432555.698111:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432555.698123:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b33563ecb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ecbc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432555.698135:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b33563ecb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ecbc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432555.698146:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787432555.698149:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948411b1c000 from 7 10000000:01000000:2.0:1787432555.698152:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787432555.698226:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b33563ecc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432555.698235:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b33563ecc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432555.698245:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b33563ecc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432555.698281:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609412992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787432555.698351:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432555.698391:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037eab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432555.698823:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609412992 00000100:00100000:1.0:1787432555.698831:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609412992 00000100:00100000:1.0:1787432555.698875:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787432555.698884:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609412992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432555.698897:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432555.698910:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303850600/0xca72b3b33563ecca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ecc3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432555.698934:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303850600/0xca72b3b33563ecca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ecc3 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432555.698946:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303850600/0xca72b3b33563ecca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ecc3 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432555.698955:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850600, rc 0) 00000100:00100000:1.0:1787432555.698997:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609412992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432555.699004:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1787432555.699563:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609412992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432555.699581:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b33563ecc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ecca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432555.699590:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b33563ecc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ecca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432555.699686:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609413120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432555.699722:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432555.699753:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037eab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432555.699782:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609413120 00000100:00100000:2.0:1787432555.699786:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609413120 00000100:00100000:2.0:1787432555.699818:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1787432555.699825:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609413120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432555.699937:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609413120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432555.699944:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1787432555.699975:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609413120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432555.700002:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609413248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432555.700042:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432555.700055:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037eab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432555.700073:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609413248 00000100:00100000:2.0:1787432555.700077:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609413248 00000100:00100000:2.0:1787432555.700095:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787432555.700102:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609413248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432555.700213:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609413248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432555.700232:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787432555.700272:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609413248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787432555.713901:0:13226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787432555.718311:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787432555.718350:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432555.718361:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b33563ecc3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ecca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432555.718374:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b33563ecc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ecca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432555.731524:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432555.982411:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609413376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432555.982495:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432555.982566:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609413376 00000100:00100000:3.0:1787432555.982574:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609413376 00000100:00100000:3.0:1787432555.982628:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787432555.982640:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830383b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609413376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787432555.982684:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432555.982730:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830383b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609413376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432555.982738:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1787432555.982757:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787432555.982787:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843489dc00 x1874258609413376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432555.982806:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609413376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432555.984672:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843489dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609413632:0@lo:400:kworker.0 00000100:00100000:3.0:1787432555.984731:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432555.984766:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609414144:0@lo:400:kworker.0 00000100:00100000:3.0:1787432555.984789:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432555.984826:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609414656:0@lo:400:kworker.0 00000100:00100000:3.0:1787432555.984847:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432555.984868:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787432555.984874:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609413760:0@lo:400:kworker.0 00000100:00100000:3.0:1787432555.984899:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432555.984913:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609414272:0@lo:400:kworker.0 00000100:00100000:3.0:1787432555.984932:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432555.984950:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609414784:0@lo:400:kworker.0 00000100:00100000:3.0:1787432555.984969:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432555.985014:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609413632 00000100:00100000:3.0:1787432555.985020:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609413632 00000100:00100000:3.0:1787432555.985057:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609414144 00000100:00100000:3.0:1787432555.985060:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609414144 00000100:00100000:3.0:1787432555.985079:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609414656 00000100:00100000:3.0:1787432555.985082:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609414656 00000100:00100000:3.0:1787432555.985093:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609414272 00000100:00100000:3.0:1787432555.985095:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609414272 00000100:00100000:3.0:1787432555.985107:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609414784 00000100:00100000:3.0:1787432555.985110:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609414784 00000100:00100000:3.0:1787432555.985136:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787432555.985144:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609413632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432555.985435:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787432555.985446:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609414144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432555.985527:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787432555.985537:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609414656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432555.985700:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609413632:12345-0@lo:400:kworker.0 Request processed in 555us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432555.985709:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787432555.985731:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787432555.985739:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609414272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432555.987496:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609414144:12345-0@lo:400:kworker.0 Request processed in 2043us (2695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432555.987521:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787432555.987556:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787432555.987568:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609414784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432555.987628:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609414784:12345-0@lo:400:kworker.0 Request processed in 65us (2657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432555.987634:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787432555.991179:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609414656:12345-0@lo:400:kworker.0 Request processed in 5622us (6307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432555.991195:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787432555.991259:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609413760 00000100:00100000:0.0:1787432555.991267:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609413760 00000100:00100000:0.0:1787432555.991307:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787432555.991314:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609413760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432555.991383:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609413760:12345-0@lo:400:kworker.0 Request processed in 69us (6482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432555.991396:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787432555.991434:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830383bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609413504:0@lo:400:kworker.0 00000100:00100000:0.0:1787432555.991476:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432555.991513:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609414016:0@lo:400:kworker.0 00000100:00100000:0.0:1787432555.991537:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432555.991554:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609414528:0@lo:400:kworker.0 00000100:00100000:0.0:1787432555.991575:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432555.991592:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609415040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432555.991615:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432555.991638:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787432555.991644:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609413888:0@lo:400:kworker.0 00000100:00100000:0.0:1787432555.991666:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432555.991683:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609414400:0@lo:400:kworker.0 00000100:00100000:0.0:1787432555.991702:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432555.991718:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609414912:0@lo:400:kworker.0 00000100:00100000:0.0:1787432555.991735:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432555.991762:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609413504 00000100:00100000:0.0:1787432555.991765:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609413504 00000100:00100000:0.0:1787432555.991791:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787432555.991798:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3642:x1874258609413504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432555.991833:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3642:x1874258609413504:12345-0@lo:400:kworker.0 Request processed in 35us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432555.991839:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787432555.991864:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609414016 00000100:00100000:0.0:1787432555.991874:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609414016 00000100:00100000:0.0:1787432555.991896:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787432555.991902:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609414016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432555.991933:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609414016:12345-0@lo:400:kworker.0 Request processed in 32us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432555.991939:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787432555.991957:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609414528 00000100:00100000:0.0:1787432555.991961:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609414528 00000100:00100000:0.0:1787432555.992006:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609414400 00000100:00100000:0.0:1787432555.992009:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609414400 00000100:00100000:0.0:1787432555.992022:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609414912 00000100:00100000:0.0:1787432555.992024:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609414912 00000100:00100000:0.0:1787432555.992041:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787432555.992047:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609414528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432555.992077:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609414528:12345-0@lo:400:kworker.0 Request processed in 30us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432555.992083:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787432555.992093:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787432555.992099:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609414400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432555.992127:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609414400:12345-0@lo:400:kworker.0 Request processed in 28us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432555.992132:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787432555.992142:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787432555.992148:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609414912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432555.992200:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609414912:12345-0@lo:400:kworker.0 Request processed in 52us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432555.992206:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787432555.992235:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609415040 00000100:00100000:0.0:1787432555.992239:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609415040 00000100:00100000:0.0:1787432555.992263:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787432555.992269:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609415040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787432555.992297:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432555.992330:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609415040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432555.992335:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787432555.992365:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609413888 00000100:00100000:0.0:1787432555.992368:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609413888 00000100:00100000:0.0:1787432555.992388:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787432555.992393:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609413888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432555.992435:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609413888:12345-0@lo:400:kworker.0 Request processed in 41us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432555.992440:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787432555.992482:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609413888:0@lo:400:kworker.0 00010000:00080000:0.0:1787432555.992496:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303798000 x1874258609414400/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432555.992506:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609414400:0@lo:400:kworker.0 00010000:00080000:0.0:1787432555.992515:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830379aa00 x1874258609414912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432555.992523:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609414912:0@lo:400:kworker.0 00000100:00100000:0.0:1787432555.992531:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830383bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609413504:0@lo:400:kworker.0 00000100:00100000:0.0:1787432555.992540:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609414016:0@lo:400:kworker.0 00010000:00080000:0.0:1787432555.992560:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303798e00 x1874258609414528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432555.992569:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609414528:0@lo:400:kworker.0 00010000:00080000:0.0:1787432555.992577:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303b39f80 x1874258609415040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432555.992591:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609415040:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787432555.993258:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787432555.993264:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787432555.993266:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432555.993306:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609413760:0@lo:400:kworker.0 00000100:00100000:3.0:1787432555.997766:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609414272:12345-0@lo:400:kworker.0 Request processed in 12018us (12822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432555.997783:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00010000:00080000:2.0:1787432556.003088:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830379b480 x1874258609414272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432556.003108:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609414272:0@lo:400:kworker.0 00010000:00080000:2.0:1787432556.003122:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303798380 x1874258609414784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432556.003131:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609414784:0@lo:400:kworker.0 00000100:00100000:2.0:1787432556.003155:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843489dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609413632:0@lo:400:kworker.0 00000100:00100000:2.0:1787432556.003182:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609414144:0@lo:400:kworker.0 00000100:00100000:2.0:1787432556.003195:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609414656:0@lo:400:kworker.0 00000100:00100000:1.0:1787432556.118005:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432556.119434:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588356352 00000100:00100000:3.0:1787432556.119450:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588356352 00000100:00100000:3.0:1787432556.119508:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 334 00000100:00100000:3.0:1787432556.119518:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+11:6175:x1874258588356352:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432556.119535:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432556.119553:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303012200/0xca72b3b33563ecd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4cea expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432556.119593:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303012200/0xca72b3b33563ecd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cea expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432556.119604:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303012200/0xca72b3b33563ecd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cea expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432556.119613:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303012200, rc 0) 00000100:00100000:3.0:1787432556.119708:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+12:6175:x1874258588356352:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 174us (1852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432556.119715:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 334 00000100:00100000:0.0:1787432556.123770:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432556.124124:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588356480 00000100:00100000:1.0:1787432556.124134:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588356480 00000100:00100000:1.0:1787432556.124215:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 335 00000100:00100000:1.0:1787432556.124225:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+12:6175:x1874258588356480:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432556.124363:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+12:6175:x1874258588356480:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 139us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432556.124372:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 335 00000100:00100000:3.0:1787432556.126250:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432556.126329:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588356608 00000100:00100000:0.0:1787432556.126338:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588356608 00000100:00100000:0.0:1787432556.126383:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 336 00000100:00100000:0.0:1787432556.126392:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+12:6175:x1874258588356608:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432556.126537:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+12:6175:x1874258588356608:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 Request processed in 144us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432556.126545:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 336 00000100:00100000:0.0:1787432556.131945:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432556.132211:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588356736 00000100:00100000:3.0:1787432556.132223:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588356736 00000100:00100000:3.0:1787432556.132280:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 337 00000100:00100000:3.0:1787432556.132292:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+12:6175:x1874258588356736:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432556.132312:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432556.132337:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303013c00/0xca72b3b33563ecd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4cf1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432556.132366:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303013c00/0xca72b3b33563ecd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cf1 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432556.132378:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303013c00/0xca72b3b33563ecd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cf1 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432556.132399:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303013c00, rc 0) 00000100:00100000:3.0:1787432556.132480:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:6175:x1874258588356736:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 190us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432556.132487:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 337 00000100:00100000:3.0:1787432556.135739:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432556.135844:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588356864 00000100:00100000:1.0:1787432556.135854:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588356864 00000100:00100000:1.0:1787432556.135909:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 338 00000100:00100000:1.0:1787432556.135920:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:6175:x1874258588356864:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432556.136068:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:6175:x1874258588356864:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 149us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432556.136076:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 338 00000100:00100000:1.0:1787432556.139140:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432556.139251:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588356992 00000100:00100000:0.0:1787432556.139261:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588356992 00000100:00100000:0.0:1787432556.139322:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 339 00000100:00100000:0.0:1787432556.139334:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:6175:x1874258588356992:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432556.139515:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:6175:x1874258588356992:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 Request processed in 181us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432556.139523:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 339 00010000:00010000:2.0:1787432556.748512:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432557.515422:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432557.515450:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609415168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432557.515538:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432557.515635:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609415168 00000100:00100000:1.0:1787432557.515643:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609415168 00000100:00100000:1.0:1787432557.515688:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787432557.515697:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609415168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787432557.515733:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787432557.515780:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609415168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432557.515788:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787432557.515838:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609415168:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787432557.778453:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432558.102118:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432558.102188:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432558.102242:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432558.102269:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432558.102292:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432558.102320:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588357120 00000100:00100000:0.0:1787432558.102343:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588357120 00000100:00100000:2.0:1787432558.102423:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588357248 00000100:00100000:2.0:1787432558.102429:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588357248 00000100:00100000:2.0:1787432558.102483:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588357504 00000100:00100000:0.0:1787432558.102484:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 340 00000100:00100000:2.0:1787432558.102488:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588357504 00000100:00100000:0.0:1787432558.102501:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588357120:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432558.102508:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588357376 00000100:00100000:2.0:1787432558.102512:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588357376 00000100:00100000:2.0:1787432558.102525:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588357632 00000100:00100000:2.0:1787432558.102527:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588357632 00000100:00100000:2.0:1787432558.102540:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 219 00000100:00100000:2.0:1787432558.102547:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2400:x1874258588357248:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432558.102614:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2400:x1874258588357248:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 67us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432558.102617:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588357120:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 120us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432558.102625:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 219 00000100:00100000:0.0:1787432558.102631:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 340 00000100:00100000:2.0:1787432558.102645:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 220 00000100:00100000:2.0:1787432558.102653:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588357504:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432558.102679:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 221 00000100:00100000:2.0:1787432558.102680:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588357504:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432558.102690:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 220 00000100:00100000:0.0:1787432558.102695:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830383bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588357376:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432558.102714:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 222 00000100:00100000:2.0:1787432558.102723:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588357632:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432558.102729:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830383bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588357376:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 39us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432558.102754:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 221 00000100:00100000:2.0:1787432558.102849:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588357632:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 127us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432558.102856:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 222 00000100:00080000:2.0:1787432558.102879:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787432558.102883:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787432558.807888:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787432558.869549:0:13399:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787432559.819604:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432560.587905:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609415296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432560.588006:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432560.588102:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609415296 00000100:00100000:1.0:1787432560.588110:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609415296 00000100:00100000:1.0:1787432560.588157:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787432560.588198:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609415296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787432560.588242:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787432560.588292:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609415296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432560.588298:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787432560.588358:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609415296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432560.589053:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432560.589067:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609415424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432560.589106:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432560.589152:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609415424 00000100:00100000:0.0:1787432560.589157:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609415424 00000100:00100000:0.0:1787432560.589223:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787432560.589231:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609415424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432560.589252:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432560.589288:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609415424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432560.589304:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:0.0:1787432560.589354:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948301e39180 x1874258609415424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432560.589369:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609415424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432560.592884:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432560.592909:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609415552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432560.592986:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787432560.593054:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432560.593550:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609415552 00000100:00100000:0.0:1787432560.593558:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609415552 00000100:00100000:0.0:1787432560.593632:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787432560.593642:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609415552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787432560.593667:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432560.593722:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609415552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432560.593729:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1787432560.593769:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948433653b80 x1874258609415552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432560.593789:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609415552:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787432560.593898:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787432560.848900:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432561.100046:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609415808:0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.100118:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432561.100192:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609416320:0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.100220:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432561.100245:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609416832:0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.100265:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432561.100288:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787432561.100294:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609415680:0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.100336:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432561.100358:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609416192:0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.100383:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432561.100400:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609416704:0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.100437:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432561.100453:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609417216:0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.100472:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432561.100498:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609415808 00000100:00100000:3.0:1787432561.100506:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609415808 00000100:00100000:3.0:1787432561.100556:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609416320 00000100:00100000:3.0:1787432561.100559:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609416320 00000100:00100000:3.0:1787432561.100583:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609416832 00000100:00100000:3.0:1787432561.100587:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609416832 00000100:00100000:3.0:1787432561.100603:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787432561.100612:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609415808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.100663:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609415808:12345-0@lo:400:kworker.0 Request processed in 51us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432561.100671:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787432561.100688:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787432561.100695:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609416320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.100721:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609416320:12345-0@lo:400:kworker.0 Request processed in 28us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432561.100727:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787432561.100738:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787432561.100744:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609416832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.100767:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609416832:12345-0@lo:400:kworker.0 Request processed in 24us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432561.100773:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787432561.100794:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609415680 00000100:00100000:3.0:1787432561.100798:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609415680 00000100:00100000:3.0:1787432561.100819:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787432561.100832:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3644:x1874258609415680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.100863:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3644:x1874258609415680:12345-0@lo:400:kworker.0 Request processed in 32us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432561.100869:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787432561.100894:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609416192 00000100:00100000:3.0:1787432561.100898:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609416192 00000100:00100000:3.0:1787432561.100922:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787432561.100928:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609416192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.100959:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609416192:12345-0@lo:400:kworker.0 Request processed in 31us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432561.100965:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1787432561.100985:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432561.101015:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609415680:0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.101026:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609416192:0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.101037:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609415808:0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.101044:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609416320:0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.101051:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609416832:0@lo:400:kworker.0 00000100:00100000:0.0:1787432561.101189:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609415936:0@lo:400:kworker.0 00000100:00100000:0.0:1787432561.101222:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432561.101244:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609416448:0@lo:400:kworker.0 00000100:00100000:0.0:1787432561.101263:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432561.101280:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609416960:0@lo:400:kworker.0 00000100:00100000:0.0:1787432561.101298:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432561.101316:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787432561.101334:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609416064:0@lo:400:kworker.0 00000100:00100000:0.0:1787432561.101367:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432561.101386:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609416576:0@lo:400:kworker.0 00000100:00100000:0.0:1787432561.101405:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432561.101420:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609417088:0@lo:400:kworker.0 00000100:00100000:0.0:1787432561.101436:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432561.101462:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609416448 00000100:00100000:0.0:1787432561.101465:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609416448 00000100:00100000:0.0:1787432561.101492:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609416960 00000100:00100000:0.0:1787432561.101495:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609416960 00000100:00100000:0.0:1787432561.101508:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609416064 00000100:00100000:0.0:1787432561.101511:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609416064 00000100:00100000:0.0:1787432561.101522:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787432561.101528:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609416448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432561.101561:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609416448:12345-0@lo:400:kworker.0 Request processed in 33us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432561.101568:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787432561.101580:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787432561.101586:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609416960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432561.101610:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609416960:12345-0@lo:400:kworker.0 Request processed in 24us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432561.101615:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787432561.101625:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787432561.101630:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609416064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432561.101655:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609416064:12345-0@lo:400:kworker.0 Request processed in 25us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432561.101661:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787432561.101686:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609416704 00000100:00100000:0.0:1787432561.101689:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609416704 00000100:00100000:0.0:1787432561.101704:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609417216 00000100:00100000:0.0:1787432561.101707:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609417216 00000100:00100000:0.0:1787432561.101717:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609416576 00000100:00100000:0.0:1787432561.101720:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609416576 00000100:00100000:0.0:1787432561.101728:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609417088 00000100:00100000:0.0:1787432561.101730:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609417088 00000100:00100000:0.0:1787432561.101742:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787432561.101749:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609416704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432561.101782:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609416704:12345-0@lo:400:kworker.0 Request processed in 34us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432561.101788:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787432561.101799:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787432561.101804:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609417216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432561.101830:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609417216:12345-0@lo:400:kworker.0 Request processed in 25us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432561.101835:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787432561.101845:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787432561.101850:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609416576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432561.101874:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609416576:12345-0@lo:400:kworker.0 Request processed in 24us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432561.101879:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787432561.101889:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787432561.101895:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609417088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432561.101919:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609417088:12345-0@lo:400:kworker.0 Request processed in 25us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432561.101934:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1787432561.101968:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787432561.101971:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787432561.101989:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609416064:0@lo:400:kworker.0 00010000:00080000:0.0:1787432561.102001:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830379aa00 x1874258609416576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432561.102010:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609416576:0@lo:400:kworker.0 00010000:00080000:0.0:1787432561.102020:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039b4380 x1874258609417088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432561.102028:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609417088:0@lo:400:kworker.0 00010000:00080000:0.0:1787432561.102038:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303798e00 x1874258609416448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432561.102046:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609416448:0@lo:400:kworker.0 00010000:00080000:0.0:1787432561.102054:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039b5500 x1874258609416960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432561.102062:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609416960:0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.102230:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609415936 00000100:00100000:3.0:1787432561.102235:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609415936 00000100:00100000:3.0:1787432561.102265:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787432561.102272:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609415936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.102338:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609415936:12345-0@lo:400:kworker.0 Request processed in 66us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432561.102345:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787432561.102376:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609415936:0@lo:400:kworker.0 00010000:00080000:3.0:1787432561.102399:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303798000 x1874258609416704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432561.102408:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609416704:0@lo:400:kworker.0 00010000:00080000:3.0:1787432561.102418:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039b5f80 x1874258609417216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432561.102425:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609417216:0@lo:400:kworker.0 00000100:00100000:3.0:1787432561.102675:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609417344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432561.102706:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432561.102952:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609417472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432561.102974:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432561.110389:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609417344 00000100:00100000:1.0:1787432561.110405:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609417344 00000100:00100000:1.0:1787432561.110471:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609417472 00000100:00100000:1.0:1787432561.110475:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609417472 00000100:00100000:1.0:1787432561.110495:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787432561.110521:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609417344:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432561.110526:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787432561.110535:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609417472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787432561.110554:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1787432561.110564:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1787432561.115828:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948433653b80 x1874258609417472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432561.115856:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609417472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432561.116015:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609417472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4005us (11562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432561.116030:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787432561.119420:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609417344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8891us (16702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432561.119436:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:3.0:1787432561.121385:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303b38a80 x1874258609417344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432561.121417:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609417344:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787432561.869145:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432562.636145:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432562.636190:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609417600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787432562.636254:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432562.636451:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609417600 00000100:00100000:3.0:1787432562.636460:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609417600 00000100:00100000:3.0:1787432562.636513:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787432562.636523:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609417600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787432562.636557:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787432562.636607:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609417600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432562.636614:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787432562.636655:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609417600:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787432562.892470:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432563.232366:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432563.232422:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432563.232459:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432563.232491:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432563.232535:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432563.232718:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588357888 00000100:00100000:0.0:1787432563.232728:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588357888 00000100:00100000:0.0:1787432563.232799:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588358016 00000100:00100000:0.0:1787432563.232808:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588358016 00000100:00100000:0.0:1787432563.232826:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588358272 00000100:00100000:0.0:1787432563.232828:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588358272 00000100:00100000:0.0:1787432563.232840:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588358144 00000100:00100000:0.0:1787432563.232842:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588358144 00000100:00100000:0.0:1787432563.232856:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 229 00000100:00100000:0.0:1787432563.232865:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2402:x1874258588357888:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432563.232943:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2402:x1874258588357888:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 78us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432563.232950:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 229 00000100:00100000:0.0:1787432563.232967:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 230 00000100:00100000:0.0:1787432563.232985:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588358016:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432563.233009:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588358016:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 37us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432563.233015:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 230 00000100:00100000:0.0:1787432563.233027:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 231 00000100:00100000:0.0:1787432563.233033:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2403:x1874258588358272:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432563.233056:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2403:x1874258588358272:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432563.233062:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 231 00000100:00100000:0.0:1787432563.233082:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 232 00000100:00100000:0.0:1787432563.233089:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588358144:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432563.233113:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588358144:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432563.233119:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 232 00000100:00080000:2.0:1787432563.233813:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787432563.233818:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432563.233925:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588357760 00000100:00100000:3.0:1787432563.233932:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588357760 00000100:00100000:3.0:1787432563.233987:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 342 00000100:00100000:3.0:1787432563.233996:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:2403:x1874258588357760:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432563.234041:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:2403:x1874258588357760:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 47us (1618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432563.234047:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 342 00010000:00010000:1.0:1787432563.915372:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787432564.262403:0:13548:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 17:02:42 (1787432562) === 00000100:00100000:0.0:1787432564.469981:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432564.470102:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588358400 00000100:00100000:3.0:1787432564.470113:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588358400 00000100:00100000:3.0:1787432564.470222:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:3.0:1787432564.470232:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2401:x1874258588358400:12345-192.168.204.24@tcp:41:mkdir.0 00000004:00000024:3.0:1787432564.470280:0:10165:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787432564.470369:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2401:x1874258588358400:12345-192.168.204.24@tcp:41:mkdir.0 Request processed in 138us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432564.470377:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:3.0:1787432564.470471:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432564.470753:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588358528 00000100:00100000:3.0:1787432564.470759:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588358528 00000100:00100000:3.0:1787432564.470792:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 2 00000100:00100000:3.0:1787432564.470800:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:10533:x1874258588358528:12345-192.168.204.24@tcp:700:mkdir.0 00000100:00100000:3.0:1787432564.470846:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:10533:x1874258588358528:12345-192.168.204.24@tcp:700:mkdir.0 Request processed in 46us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432564.470853:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 2 00000100:00100000:3.0:1787432564.473369:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432564.474742:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588358784 00000100:00100000:2.0:1787432564.474758:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588358784 00000100:00100000:2.0:1787432564.474828:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:2.0:1787432564.474839:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:10533:x1874258588358784:12345-192.168.204.24@tcp:36:mkdir.0 00010000:00010000:2.0:1787432564.474897:0:9020:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432564.475108:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563eb81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c65 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.475423:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948405994f00) 00010000:00010000:2.0:1787432564.475452:0:9020:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432564.475617:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563ecdf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.475630:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563ecdf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.475639:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563ecdf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.475664:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563ece6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.475672:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563ece6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.475679:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563ece6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.476479:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f400/0xca72b3b33563eced lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.476573:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f400/0xca72b3b33563eced lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.476582:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f400/0xca72b3b33563eced lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432564.476599:0:9020:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa18ca58 reply state 00000000be9f62eb transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f400/0xca72b3b33563eced lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.476610:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f400/0xca72b3b33563eced lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.476618:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948411a6b900) 00010000:00010000:2.0:1787432564.476621:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787432564.476625:0:9020:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787432564.476631:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787432564.476637:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563ecdf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.476644:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563ecdf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.476650:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563ecdf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.476656:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fa00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432564.476660:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563ecdf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.476667:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563ecdf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.476686:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948411a6bc00) 00010000:00010000:2.0:1787432564.476688:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432564.476691:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563ecdf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.476696:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563ecdf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432564.476711:0:9020:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa18ca58 reply state 00000000be9f62eb transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563ece6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.476719:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563ece6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.476725:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff948411a6b600) 00010000:00010000:2.0:1787432564.476727:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787432564.476729:0:9020:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787432564.476836:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:10533:x1874258588358784:12345-192.168.204.24@tcp:36:mkdir.0 Request processed in 1996us (3472us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787432564.476846:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:0.0:1787432564.485538:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432564.485631:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588358912 00000100:00100000:1.0:1787432564.485645:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588358912 00000100:00100000:1.0:1787432564.485708:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:1.0:1787432564.485719:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:10534:x1874258588358912:12345-192.168.204.24@tcp:101:chmod.0 00010000:00010000:1.0:1787432564.485740:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432564.485768:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563ecf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4cf8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.485838:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563ecfb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.485853:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563ecfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.485867:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563ecfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432564.485918:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787432564.485922:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432564.485977:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563ecfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.486006:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563ecf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cf8 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.486048:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563ecfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cf8 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.486057:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94841318bf00) 00010000:00010000:1.0:1787432564.486060:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432564.486063:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851000, rc 0) 00000100:00100000:1.0:1787432564.486160:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:10534:x1874258588358912:12345-192.168.204.24@tcp:101:chmod.0 Request processed in 441us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432564.486204:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:0.0:1787432564.488447:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432564.488594:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588359168 00000100:00100000:3.0:1787432564.488619:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588359168 00000100:00100000:3.0:1787432564.488682:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:3.0:1787432564.488694:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:10534:x1874258588359168:12345-192.168.204.24@tcp:36:chmod.0 00010000:00010000:3.0:1787432564.488747:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432564.488775:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563ecfb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cf8 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.488795:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94841318bf00) 00010000:00010000:3.0:1787432564.488806:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432564.488829:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563ed02 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.488841:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563ed02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.488850:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563ed02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432564.489043:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e6c5aa1 reply state 000000003da0146a transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563ed02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.489056:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563ed02 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.489063:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435957600) 00010000:00010000:3.0:1787432564.489065:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787432564.489068:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787432564.489076:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787432564.489209:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:10534:x1874258588359168:12345-192.168.204.24@tcp:36:chmod.0 Request processed in 516us (771us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787432564.489216:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:2.0:1787432564.509261:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432564.509319:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588359296 00000100:00100000:0.0:1787432564.509332:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588359296 00000100:00100000:1.0:1787432564.510287:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 26 00000100:00100000:1.0:1787432564.510300:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:10535:x1874258588359296:12345-192.168.204.24@tcp:101:chown.0 00010000:00010000:1.0:1787432564.510327:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432564.510349:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563ed09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4cff expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.510420:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850c00/0xca72b3b33563ed10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.510438:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850c00/0xca72b3b33563ed10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.510451:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850c00/0xca72b3b33563ed10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432564.511160:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787432564.511196:0:9020:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432564.511247:0:9020:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303850c00/0xca72b3b33563ed10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.511312:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563ed09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cff expref: 11 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.511334:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850c00/0xca72b3b33563ed10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cff expref: 10 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.511343:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435957600) 00010000:00010000:1.0:1787432564.511346:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432564.511350:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850c00, rc 0) 00000100:00100000:1.0:1787432564.511430:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+10:10535:x1874258588359296:12345-192.168.204.24@tcp:101:chown.0 Request processed in 1132us (2187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432564.511438:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 26 00000100:00100000:1.0:1787432564.514008:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432564.514088:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588359424 00000100:00100000:3.0:1787432564.514097:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588359424 00000100:00100000:3.0:1787432564.514346:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 27 00000100:00100000:3.0:1787432564.514358:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+10:10535:x1874258588359424:12345-192.168.204.24@tcp:101:chown.0 00010000:00010000:3.0:1787432564.514382:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432564.514401:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d06 expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514465:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563ed1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514480:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563ed1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514492:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563ed1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514503:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514511:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514517:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514601:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563ed2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514609:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563ed2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514636:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563ed2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432564.514684:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787432564.514688:0:10165:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787432564.514725:0:10165:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563ed2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514738:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563ed1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514744:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563ed1e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514750:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563ed1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514756:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303012000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432564.514762:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563ed1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514769:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563ed1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514784:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435957600) 00010000:00010000:3.0:1787432564.514787:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432564.514791:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563ed1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514797:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563ed1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514821:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514827:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514834:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514839:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432564.514842:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514847:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514855:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff948411a6b600) 00010000:00010000:3.0:1787432564.514857:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432564.514860:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed25 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514866:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514894:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d06 expref: 12 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514906:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563ed2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d06 expref: 11 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.514924:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948411a6b900) 00010000:00010000:3.0:1787432564.514927:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432564.514930:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303012400, rc 0) 00000100:00100000:3.0:1787432564.515002:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+11:10535:x1874258588359424:12345-192.168.204.24@tcp:101:chown.0 Request processed in 646us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432564.515010:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 27 00000100:00100000:0.0:1787432564.521113:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432564.521416:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588359552 00000100:00100000:3.0:1787432564.521426:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588359552 00000100:00100000:3.0:1787432564.521499:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 6 00000100:00100000:3.0:1787432564.521510:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+11:10535:x1874258588359552:12345-192.168.204.24@tcp:900:chown.0 00000100:00100000:3.0:1787432564.521603:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+11:10535:x1874258588359552:12345-192.168.204.24@tcp:900:chown.0 Request processed in 94us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432564.521611:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 6 00000100:00100000:2.0:1787432564.527043:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432564.527201:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588359808 00000100:00100000:0.0:1787432564.527219:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588359808 00000100:00100000:0.0:1787432564.527303:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 28 00000100:00100000:0.0:1787432564.527317:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+11:10535:x1874258588359808:12345-192.168.204.24@tcp:36:chown.0 00010000:00010000:0.0:1787432564.527382:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432564.527416:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563ed2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d06 expref: 11 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.527438:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948411a6b900) 00010000:00010000:0.0:1787432564.527443:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432564.527468:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563ed33 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.527482:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563ed33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.527689:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563ed33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787432564.531472:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:1.0:1787432564.531645:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563ece6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531660:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563ece6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531670:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563ece6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531678:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fe00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432564.531682:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563ece6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531690:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563ece6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531739:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff948411a6b600) 00010000:00010000:1.0:1787432564.531742:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432564.531748:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563ece6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531756:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563ece6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531778:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f400/0xca72b3b33563eced lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531785:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f400/0xca72b3b33563eced lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531791:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f400/0xca72b3b33563eced lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531796:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85f400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432564.531800:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f400/0xca72b3b33563eced lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531806:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f400/0xca72b3b33563eced lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531815:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948411a6b900) 00010000:00010000:1.0:1787432564.531817:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432564.531820:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f400/0xca72b3b33563eced lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531827:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f400/0xca72b3b33563eced lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531851:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563ed02 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531858:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563ed02 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531864:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563ed02 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531870:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303012600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432564.531874:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563ed02 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531880:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563ed02 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531891:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435957600) 00010000:00010000:1.0:1787432564.531894:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787432564.531897:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563ed02 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.531903:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563ed02 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787432564.532098:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083ea1775 reply state 000000008e46e1a5 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563ed33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.532115:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563ed33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.532123:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948411a6b900) 00010000:00010000:1.0:1787432564.532131:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787432564.532135:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787432564.532151:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1787432564.532460:0:6513:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00010000:00010000:2.0:1787432564.532660:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563ed33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.532671:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563ed33 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.532678:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563ed33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.532695:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432564.532711:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563ed33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.532718:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563ed33 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.532728:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948411a6b900) 00010000:00010000:2.0:1787432564.532731:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787432564.532735:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563ed33 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.532740:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563ed33 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432564.532843:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:10535:x1874258588359808:12345-192.168.204.24@tcp:36:chown.0 Request processed in 5176us (5458us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787432564.532853:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 28 00000100:00100000:0.0:1787432564.549221:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432564.549364:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588359936 00000100:00100000:1.0:1787432564.549376:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588359936 00000100:00100000:1.0:1787432564.549438:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 29 00000100:00100000:1.0:1787432564.549450:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:10536:x1874258588359936:12345-192.168.204.24@tcp:101:touch.500 00010000:00010000:1.0:1787432564.549479:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432564.549499:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563ed3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d0d expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787432564.556436:0:9020:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6872us 00010000:00010000:3.0:1787432564.571650:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.571895:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.571911:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.571929:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.571936:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.571960:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572093:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563ed4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572101:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563ed4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572108:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563ed4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432564.572152:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787432564.572156:0:9020:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787432564.572421:0:9020:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563ed4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572436:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572443:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed41 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572528:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572536:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432564.572540:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572548:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572568:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435957600) 00010000:00010000:3.0:1787432564.572571:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432564.572575:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572581:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572594:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572599:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572605:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572609:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432564.572612:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572618:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572623:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff948435957b00) 00010000:00010000:3.0:1787432564.572625:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432564.572628:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572633:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572870:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563ed3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d0d expref: 8 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572887:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563ed4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d0d expref: 7 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.572894:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948435957f00) 00010000:00010000:3.0:1787432564.572895:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787432564.572898:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303012000, rc 0) 00000100:00100000:3.0:1787432564.572979:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:10536:x1874258588359936:12345-192.168.204.24@tcp:101:touch.500 Request processed in 23530us (23816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432564.572988:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 29 00000100:00100000:0.0:1787432564.581359:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432564.581511:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588360192 00000100:00100000:3.0:1787432564.581521:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588360192 00000100:00100000:3.0:1787432564.581582:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 30 00000100:00100000:3.0:1787432564.581592:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:10536:x1874258588360192:12345-192.168.204.24@tcp:101:touch.500 00010000:00010000:3.0:1787432564.581615:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432564.581635:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013000/0xca72b3b33563ed56 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d14 expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.582393:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed5d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.582409:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.582420:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.582502:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed64 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.582510:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.582517:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787432564.586145:0:10165:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787432564.586406:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563ed6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.586424:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563ed6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.586435:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563ed6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.586473:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.586480:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed5d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.586499:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.586505:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432564.586510:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.586518:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.586531:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948435957f00) 00010000:00010000:2.0:1787432564.586534:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432564.586538:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed5d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.586543:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ed5d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432564.586556:0:10165:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000719e15dc reply state 000000001c97efdd transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.586567:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.586572:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb4e9f8bc (ffff948435957b00) 00010000:00010000:2.0:1787432564.586574:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787432564.586577:0:10165:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787432564.586614:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013000/0xca72b3b33563ed56 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d14 expref: 10 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.586627:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563ed6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d14 expref: 9 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.586642:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff948405994400) 00010000:00010000:2.0:1787432564.586644:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432564.586646:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e600, rc 0) 00000100:00100000:2.0:1787432564.587087:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+10:10536:x1874258588360192:12345-192.168.204.24@tcp:101:touch.500 Request processed in 5495us (5739us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787432564.587097:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 30 00000100:00100000:3.0:1787432564.600935:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432564.601002:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588360448 00000100:00100000:1.0:1787432564.601012:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588360448 00000100:00100000:1.0:1787432564.601065:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 31 00000100:00100000:1.0:1787432564.601076:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+10:10536:x1874258588360448:12345-192.168.204.24@tcp:36:touch.500 00010000:00010000:1.0:1787432564.601135:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432564.601242:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563ed6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d14 expref: 10 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.601274:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff948405994400) 00010000:00010000:1.0:1787432564.601285:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432564.601349:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ed79 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.601377:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ed79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.601386:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ed79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787432564.604082:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a9eca12 reply state 00000000e47b190d transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ed79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.604111:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ed79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.604121:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff94841318b800) 00010000:00010000:1.0:1787432564.604124:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787432564.604128:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787432564.604281:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+11:10536:x1874258588360448:12345-192.168.204.24@tcp:36:touch.500 Request processed in 3202us (3350us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787432564.604292:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 31 00000100:00100000:2.0:1787432564.607157:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432564.607667:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588360576 00000100:00100000:3.0:1787432564.607679:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588360576 00000100:00100000:3.0:1787432564.607750:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 32 00000100:00100000:3.0:1787432564.607762:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+11:10536:x1874258588360576:12345-192.168.204.24@tcp:101:touch.500 00010000:00010000:3.0:1787432564.607787:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432564.607808:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563ed80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d1b expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.607868:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563ed80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d1b expref: 12 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.607883:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563ed80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d1b expref: 12 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.607902:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff94841318b800) 00010000:00010000:3.0:1787432564.607905:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787432564.607909:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303012800, rc 0) 00000100:00100000:3.0:1787432564.607991:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+12:10536:x1874258588360576:12345-192.168.204.24@tcp:101:touch.500 Request processed in 231us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432564.608013:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 32 00000100:00100000:0.0:1787432564.611973:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432564.612147:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588360704 00000100:00100000:2.0:1787432564.612160:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588360704 00000100:00100000:2.0:1787432564.612232:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:2.0:1787432564.612241:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1874258588360704:12345-192.168.204.24@tcp:8:touch.500 00010000:00080000:2.0:1787432564.612288:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp t0 exp 0000000000000000 cur 375 last 0 00000020:00000080:2.0:1787432564.612352:0:8432:0:(genops.c:1385:class_connect()) connect: client e37f63ac-9665-4d30-ad26-0faad6e6c7da, cookie 0xca72b3b33563ed87 00002000:00100000:2.0:1787432564.612368:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e37f63ac-9665-4d30-ad26-0faad6e6c7da/ffff94843f838000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787432564.612390:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787432564.612473:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787432564.612504:0:8432:0:(import.c:65:import_set_state_nolock()) ffff94843f83d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432564.613008:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2399:x1874258588360704:12345-192.168.204.24@tcp:8:touch.500 Request processed in 764us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432564.613017:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:2.0:1787432564.619013:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432564.619377:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588360832 00000100:00100000:0.0:1787432564.619388:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588360832 00000100:00080000:2.0:1787432564.619450:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432564.619472:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:0.0:1787432564.619484:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:0:x1874258588360832:12345-192.168.204.24@tcp:2:touch.500 00000001:00080000:3.0:1787432564.630568:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:3.0:1787432564.630583:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000100:00100000:0.0:1787432564.630795:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:0:x1874258588360832:12345-192.168.204.24@tcp:2:touch.500 Request processed in 11307us (11788us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787432564.630807:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:2.0:1787432564.640478:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432564.640710:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588361088 00000100:00100000:1.0:1787432564.640720:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588361088 00000100:00100000:1.0:1787432564.640779:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 2 00000100:00100000:1.0:1787432564.640790:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+12:10536:x1874258588361088:12345-192.168.204.24@tcp:35:touch.500 00000100:00100000:1.0:1787432564.641083:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+13:10536:x1874258588361088:12345-192.168.204.24@tcp:35:touch.500 Request processed in 293us (611us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787432564.641092:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 2 00000100:00100000:1.0:1787432564.664516:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432564.664614:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588361216 00000100:00100000:2.0:1787432564.664637:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588361216 00000100:00100000:2.0:1787432564.664687:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 33 00000100:00100000:2.0:1787432564.664697:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+13:10537:x1874258588361216:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787432564.664719:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432564.664740:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563ed8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d22 expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.664810:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563ed95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.664822:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563ed95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.664832:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563ed95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432564.664875:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787432564.664879:0:10165:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787432564.664912:0:10165:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563ed95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.664938:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563ed8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d22 expref: 15 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.664954:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563ed95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d22 expref: 14 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432564.664962:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948435957f00) 00010000:00010000:2.0:1787432564.664965:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432564.664969:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85ee00, rc 0) 00000100:00100000:2.0:1787432564.665044:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:10537:x1874258588361216:12345-192.168.204.24@tcp:101:rm.0 Request processed in 348us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432564.665051:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 33 00000100:00100000:2.0:1787432564.671070:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432564.671358:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588361472 00000100:00100000:1.0:1787432564.671368:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588361472 00000100:00100000:1.0:1787432564.671449:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 34 00000100:00100000:1.0:1787432564.671460:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:10537:x1874258588361472:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787432564.671480:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432564.671499:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851800/0xca72b3b33563ed9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d29 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432564.671598:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787432564.671725:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851800/0xca72b3b33563ed9c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d29 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.671741:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435957600) 00010000:00010000:1.0:1787432564.671743:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787432564.671747:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851800/0xca72b3b33563ed9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d29 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.671761:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851800, rc 0) 00000100:00100000:1.0:1787432564.671825:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:10537:x1874258588361472:12345-192.168.204.24@tcp:101:rm.0 Request processed in 368us (767us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1787432564.671832:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 34 00000100:00100000:3.0:1787432564.681403:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432564.681603:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588361600 00000100:00100000:1.0:1787432564.681614:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588361600 00000100:00100000:1.0:1787432564.681673:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:1.0:1787432564.681684:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:10537:x1874258588361600:12345-192.168.204.24@tcp:37:rm.0 00000100:00100000:0.0:1787432564.694517:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:10537:x1874258588361600:12345-192.168.204.24@tcp:37:rm.0 Request processed in 12818us (13109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432564.694531:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:2.0:1787432564.703660:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432564.703896:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588361856 00000100:00100000:3.0:1787432564.703907:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588361856 00000100:00100000:3.0:1787432564.703988:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 4 00000100:00100000:3.0:1787432564.704000:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948411a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:10537:x1874258588361856:12345-192.168.204.24@tcp:35:rm.0 00000100:00100000:3.0:1787432564.704341:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948411a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:10537:x1874258588361856:12345-192.168.204.24@tcp:35:rm.0 Request processed in 342us (689us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787432564.704350:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 4 00000100:00100000:3.0:1787432564.713708:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432564.713923:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588362112 00000100:00100000:1.0:1787432564.713934:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588362112 00000100:00100000:1.0:1787432564.714062:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 35 00000100:00100000:1.0:1787432564.714074:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:10537:x1874258588362112:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787432564.714114:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432564.714135:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851800/0xca72b3b33563edaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d30 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.714291:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851200/0xca72b3b33563edb1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.714306:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851200/0xca72b3b33563edb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.714318:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851200/0xca72b3b33563edb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432564.714328:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787432564.714463:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851800/0xca72b3b33563edaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d30 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.714495:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851200/0xca72b3b33563edb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d30 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.714754:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948435957f00) 00010000:00010000:1.0:1787432564.714757:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787432564.714760:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851200, rc 0) 00000100:00100000:0.0:1787432564.716726:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:10537:x1874258588362112:12345-192.168.204.24@tcp:101:rm.0 Request processed in 2643us (3018us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787432564.716739:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 35 00000100:00100000:2.0:1787432564.731287:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432564.733104:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588362240 00000100:00100000:0.0:1787432564.733120:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588362240 00000100:00100000:0.0:1787432564.733235:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 36 00000100:00100000:0.0:1787432564.733256:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:10537:x1874258588362240:12345-192.168.204.24@tcp:41:rm.0 00000004:00000024:0.0:1787432564.733315:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1787432564.733392:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:10537:x1874258588362240:12345-192.168.204.24@tcp:41:rm.0 Request processed in 148us (2115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432564.733401:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 36 00000100:00100000:2.0:1787432564.738588:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432564.738725:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588362368 00000100:00100000:3.0:1787432564.738736:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588362368 00000100:00100000:3.0:1787432564.738795:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 37 00000100:00100000:3.0:1787432564.738806:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:10537:x1874258588362368:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787432564.738829:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432564.738853:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013000/0xca72b3b33563edbf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d37 expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.738919:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563edc6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.738934:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563edc6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.738945:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563edc6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.738984:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563edcd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.738992:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563edcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.738999:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563edcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739085:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563edd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739095:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563edd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739101:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563edd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432564.739141:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787432564.739145:0:9020:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787432564.739207:0:9020:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563edd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739220:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563edd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739228:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563edc6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739234:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563edc6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739264:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563edc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739271:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432564.739275:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563edc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739284:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563edc6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739296:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948435957f00) 00010000:00010000:3.0:1787432564.739300:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432564.739304:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563edc6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739310:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563edc6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739323:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563edcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739328:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563edcd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739333:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563edcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739338:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303012600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432564.739341:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563edcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739357:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563edcd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739365:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb4e9f8bc (ffff948435957b00) 00010000:00010000:3.0:1787432564.739367:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432564.739370:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563edcd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739376:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012600/0xca72b3b33563edcd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739405:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013000/0xca72b3b33563edbf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d37 expref: 20 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739419:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563edd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d37 expref: 19 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.739427:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff94841318b800) 00010000:00010000:3.0:1787432564.739429:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432564.739432:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303012400, rc 0) 00000100:00100000:3.0:1787432564.739491:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:10537:x1874258588362368:12345-192.168.204.24@tcp:101:rm.0 Request processed in 686us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432564.739511:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 37 00000100:00100000:2.0:1787432564.745934:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432564.746063:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588362624 00000100:00100000:0.0:1787432564.746073:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588362624 00000100:00100000:0.0:1787432564.746144:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 38 00000100:00100000:0.0:1787432564.746154:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:10537:x1874258588362624:12345-192.168.204.24@tcp:36:rm.0 00010000:00010000:0.0:1787432564.746261:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787432564.746304:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563edd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d37 expref: 19 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.746326:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563ed80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d1b expref: 18 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.746338:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff94841318b800) 00010000:00010000:0.0:1787432564.746350:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563ed95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d22 expref: 17 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.746358:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948435957f00) 00010000:00010000:0.0:1787432564.746361:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432564.746385:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eddb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.746397:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eddb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.746407:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eddb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.746418:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563ede2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.746425:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563ede2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.746431:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563ede2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.746652:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ede9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.746667:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ede9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.746673:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ede9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787432564.747095:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787432564.747106:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375838941169ns, next at 376838938637ns, rc = 0 00010000:00010000:0.0:1787432564.747398:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563edf0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747409:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563edf0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747418:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563edf0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747425:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563edf0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747432:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563edf0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747438:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563edf0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747460:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787432564.747600:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ede9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747609:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ede9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747625:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ede9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747631:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432564.747635:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ede9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747642:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ede9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747653:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff94841318b800) 00010000:00010000:0.0:1787432564.747656:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787432564.747659:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ede9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747665:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ede9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747683:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eddb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747689:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eddb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747694:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eddb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747699:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432564.747702:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eddb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747717:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eddb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747726:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948435957f00) 00010000:00010000:0.0:1787432564.747728:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432564.747731:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eddb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.747736:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eddb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787432564.747747:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ecc216b reply state 000000001f03ed98 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563ede2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.748019:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432564.748028:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563edf0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.748036:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94840149f000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432564.748046:0:9519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563edf0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.748053:0:9519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563edf0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.748064:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff94841318b800) 00010000:00010000:3.0:1787432564.748066:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787432564.748069:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563edf0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.748074:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563edf0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432564.748087:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432564.748089:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432564.748090:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432564.751038:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563ede2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.751048:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb4e9f8bc (ffff948435957b00) 00010000:00010000:0.0:1787432564.751052:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787432564.751057:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787432564.751204:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:10537:x1874258588362624:12345-192.168.204.24@tcp:36:rm.0 Request processed in 5046us (5275us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787432564.751212:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 38 00000100:00100000:0.0:1787432564.784297:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432564.784381:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588362880 00000100:00100000:3.0:1787432564.784392:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588362880 00000100:00100000:3.0:1787432564.784459:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 5 00000100:00100000:3.0:1787432564.784470:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:10537:x1874258588362880:12345-192.168.204.24@tcp:35:rm.0 00000100:00100000:3.0:1787432564.784953:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:10537:x1874258588362880:12345-192.168.204.24@tcp:35:rm.0 Request processed in 475us (656us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787432564.784962:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 5 00000100:00100000:2.0:1787432564.801276:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432564.805107:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588363136 00000100:00100000:1.0:1787432564.805123:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588363136 00000100:00100000:1.0:1787432564.805232:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 39 00000100:00100000:1.0:1787432564.805254:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:10537:x1874258588363136:12345-192.168.204.24@tcp:36:rm.0 00010000:00010000:1.0:1787432564.805350:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787432564.805379:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851200/0xca72b3b33563edb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d30 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.805416:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563ed4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d0d expref: 18 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.805427:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948435957f00) 00010000:00010000:1.0:1787432564.805441:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850c00/0xca72b3b33563ed10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cff expref: 17 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432564.805448:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435957600) 00010000:00010000:1.0:1787432564.805453:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432564.805605:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563edf7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.805622:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563edf7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.805634:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563edf7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.805658:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ea00/0xca72b3b33563edfe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.805666:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ea00/0xca72b3b33563edfe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.805673:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ea00/0xca72b3b33563edfe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.805781:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563ee05 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.805790:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563ee05 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.805797:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563ee05 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432564.806059:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787432564.806075:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563ee05 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.806082:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563ee05 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.806088:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563ee05 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.806095:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94840149f200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432564.806101:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563ee05 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.806120:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563ee05 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.806130:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff948435915600) 00010000:00010000:0.0:1787432564.806133:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787432564.806137:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563ee05 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.806142:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563ee05 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.806211:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563edf7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.806218:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563edf7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.806224:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563edf7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.806230:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94840149ec00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432564.806233:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563edf7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.806239:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563edf7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.806255:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435915f00) 00010000:00010000:0.0:1787432564.806258:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432564.806261:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563edf7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.806277:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563edf7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787432564.806291:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a880bf9f reply state 000000008d1c5ff4 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ea00/0xca72b3b33563edfe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.806303:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ea00/0xca72b3b33563edfe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432564.806310:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff948435915e00) 00010000:00010000:0.0:1787432564.806313:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787432564.806325:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787432564.806437:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:10537:x1874258588363136:12345-192.168.204.24@tcp:36:rm.0 Request processed in 1193us (5168us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787432564.806447:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 39 00010000:00010000:2.0:1787432564.939807:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432565.710402:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609417728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432565.710645:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432565.713120:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609417728 00000100:00100000:0.0:1787432565.713135:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609417728 00000100:00100000:0.0:1787432565.713224:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787432565.713249:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609417728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787432565.713285:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432565.713377:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609417728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (2733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432565.713386:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1787432565.713407:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787432565.713443:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303908000 x1874258609417728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432565.713481:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609417728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432565.713828:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609417856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432565.713868:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432565.713909:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609417856 00000100:00100000:1.0:1787432565.713913:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609417856 00000100:00100000:1.0:1787432565.713955:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787432565.713962:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609417856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432565.713972:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432565.714000:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609417856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432565.714006:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1787432565.714020:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787432565.714036:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303b3ad80 x1874258609417856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432565.714048:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609417856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432565.716328:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609417984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432565.716404:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432565.716480:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609417984 00000100:00100000:0.0:1787432565.716486:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609417984 00000100:00100000:0.0:1787432565.716528:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787432565.716536:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609417984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432565.716569:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787432565.716610:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609417984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432565.716617:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787432565.716662:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609417984:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787432565.965576:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787432566.220639:0:9958:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377312472237ns, next at 378312469745ns, rc = 0 00000100:00100000:1.0:1787432566.220656:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432566.220679:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609418112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432566.220747:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432566.220849:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609418112 00000100:00100000:2.0:1787432566.220856:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609418112 00000100:00080000:1.0:1787432566.220917:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432566.220941:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787432566.220952:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609418112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432566.220978:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432566.221035:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609418112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432566.221043:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:1.0:1787432566.221111:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483038c6d80 x1874258609418112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432566.221131:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609418112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432566.221339:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432566.221350:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609418240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787432566.221380:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432566.221455:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609418240 00000100:00100000:3.0:1787432566.221460:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609418240 00000100:00100000:3.0:1787432566.221504:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787432566.221512:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609418240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787432566.221524:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432566.221667:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609418624:0@lo:400:kworker.0 00000100:00100000:2.0:1787432566.221700:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787432566.221707:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432566.221726:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609419136:0@lo:400:kworker.0 00000100:00100000:2.0:1787432566.221756:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432566.221782:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609418240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 266us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432566.221796:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787432566.222242:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609418752:0@lo:400:kworker.0 00000100:00100000:3.0:1787432566.222282:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609418368:0@lo:400:kworker.0 00000100:00100000:3.0:1787432566.222315:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432566.222344:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609418880:0@lo:400:kworker.0 00000100:00100000:3.0:1787432566.222371:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432566.222392:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609419392:0@lo:400:kworker.0 00000100:00100000:3.0:1787432566.222414:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787432566.222445:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303b39500 x1874258609418240/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432566.222462:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609418240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432566.222490:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609418368 00000100:00100000:3.0:1787432566.222494:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609418368 00000100:00100000:3.0:1787432566.222528:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1787432566.222536:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3644:x1874258609418368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432566.222583:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609419648:0@lo:400:kworker.0 00000100:00100000:3.0:1787432566.222588:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3644:x1874258609418368:12345-0@lo:400:kworker.0 Request processed in 52us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432566.222597:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1787432566.222617:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432566.222628:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609418624 00000100:00100000:3.0:1787432566.222632:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609418624 00000100:00100000:3.0:1787432566.222652:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609418880 00000100:00100000:3.0:1787432566.222655:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609418880 00000100:00100000:3.0:1787432566.222668:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787432566.222674:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609418624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432566.222718:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609418624:12345-0@lo:400:kworker.0 Request processed in 45us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432566.222726:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787432566.222742:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787432566.222749:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609418880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432566.222777:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609418880:12345-0@lo:400:kworker.0 Request processed in 29us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432566.222783:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787432566.222803:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609419392 00000100:00100000:3.0:1787432566.222807:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609419392 00000100:00100000:3.0:1787432566.222835:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787432566.222842:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609419392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432566.222874:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609419392:12345-0@lo:400:kworker.0 Request processed in 32us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432566.222880:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787432566.222915:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609418368:0@lo:400:kworker.0 00000100:00100000:3.0:1787432566.222925:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609418880:0@lo:400:kworker.0 00010000:00080000:3.0:1787432566.222935:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303af0000 x1874258609419392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432566.222943:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609419392:0@lo:400:kworker.0 00000100:00100000:0.0:1787432566.225257:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609418496:0@lo:400:kworker.0 00000100:00100000:2.0:1787432566.225776:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609418624:0@lo:400:kworker.0 00000100:00100000:2.0:1787432566.225825:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432566.226313:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609419136 00000100:00100000:1.0:1787432566.226321:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609419136 00000100:00100000:1.0:1787432566.226386:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609419648 00000100:00100000:1.0:1787432566.226391:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609419648 00000100:00100000:1.0:1787432566.226416:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787432566.226425:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609419136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432566.226502:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609419136:12345-0@lo:400:kworker.0 Request processed in 78us (4745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432566.226510:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787432566.226527:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787432566.226534:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609419648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432566.226562:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609419648:12345-0@lo:400:kworker.0 Request processed in 29us (3946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432566.226568:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:1.0:1787432566.226592:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787432566.226618:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303af2a00 x1874258609419136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432566.226638:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609419136:0@lo:400:kworker.0 00010000:00080000:1.0:1787432566.226651:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303af1c00 x1874258609419648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432566.226659:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609419648:0@lo:400:kworker.0 00000100:00100000:2.0:1787432566.226901:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609419264:0@lo:400:kworker.0 00000100:00100000:2.0:1787432566.226943:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432566.226990:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432566.227211:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609419008:0@lo:400:kworker.0 00000100:00100000:2.0:1787432566.227249:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432566.227326:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609418752 00000100:00100000:0.0:1787432566.227331:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609418752 00000100:00100000:0.0:1787432566.227376:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609418496 00000100:00100000:0.0:1787432566.227381:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609418496 00000100:00100000:0.0:1787432566.227405:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787432566.227414:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609418752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432566.227475:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609418752:12345-0@lo:400:kworker.0 Request processed in 61us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432566.227481:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787432566.227500:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787432566.227507:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609418496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432566.227552:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609418496:12345-0@lo:400:kworker.0 Request processed in 46us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432566.227558:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787432566.228384:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609418752:0@lo:400:kworker.0 00000100:00100000:1.0:1787432566.229744:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609419264 00000100:00100000:1.0:1787432566.229755:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609419264 00000100:00100000:1.0:1787432566.229810:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787432566.229821:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609419264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432566.230062:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609419264:12345-0@lo:400:kworker.0 Request processed in 242us (3117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432566.230069:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1787432566.230161:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303af3480 x1874258609419264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432566.230193:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609419264:0@lo:400:kworker.0 00000100:00100000:2.0:1787432566.230396:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609419520:0@lo:400:kworker.0 00000100:00100000:2.0:1787432566.230439:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432566.230620:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609418496:0@lo:400:kworker.0 00000100:00100000:0.0:1787432566.230708:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609419008 00000100:00100000:0.0:1787432566.230714:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609419008 00000100:00100000:0.0:1787432566.230764:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609419520 00000100:00100000:0.0:1787432566.230768:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609419520 00000100:00100000:0.0:1787432566.230794:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787432566.230802:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609419008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432566.230845:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609419008:12345-0@lo:400:kworker.0 Request processed in 44us (3595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432566.230851:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787432566.230879:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787432566.230887:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609419520:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787432566.231045:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432566.231069:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609419008:0@lo:400:kworker.0 00000100:00100000:2.0:1787432566.231079:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609419520:0@lo:400:kworker.0 00000100:00100000:0.0:1787432566.231123:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609419520:12345-0@lo:400:kworker.0 Request processed in 237us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432566.231131:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00010000:00010000:3.0:1787432566.992054:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432567.756371:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432567.756402:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609419776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432567.756490:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432567.756597:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609419776 00000100:00100000:2.0:1787432567.756607:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609419776 00000100:00100000:2.0:1787432567.756661:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787432567.756671:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609419776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787432567.756706:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787432567.756759:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609419776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432567.756767:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787432567.756813:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609419776:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787432568.011492:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432568.345654:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432568.345705:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432568.345740:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432568.345793:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432568.345822:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432568.345845:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432568.345883:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588363520 00000100:00100000:0.0:1787432568.345903:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588363520 00000100:00100000:0.0:1787432568.345961:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588363776 00000100:00100000:0.0:1787432568.345964:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588363776 00000100:00100000:0.0:1787432568.345978:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588363392 00000100:00100000:0.0:1787432568.345980:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588363392 00000100:00100000:0.0:1787432568.345991:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588363904 00000100:00100000:0.0:1787432568.345993:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588363904 00000100:00100000:0.0:1787432568.346008:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 239 00000100:00100000:0.0:1787432568.346017:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588363520:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432568.346101:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588363520:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 85us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432568.346109:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 239 00000100:00100000:0.0:1787432568.346126:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 240 00000100:00100000:0.0:1787432568.346145:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588363776:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432568.346212:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588363776:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 80us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432568.346219:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 240 00000100:00100000:0.0:1787432568.346231:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 241 00000100:00100000:0.0:1787432568.346237:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:2401:x1874258588363392:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432568.346265:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:2401:x1874258588363392:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432568.346270:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 241 00000100:00100000:0.0:1787432568.346282:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 242 00000100:00100000:0.0:1787432568.346288:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588363904:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432568.346310:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588363904:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 22us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432568.346324:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 242 00000100:00080000:0.0:1787432568.346341:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787432568.346346:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432568.346437:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588363264 00000100:00100000:1.0:1787432568.346442:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588363264 00000100:00100000:1.0:1787432568.346479:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 344 00000100:00100000:1.0:1787432568.346487:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:2401:x1874258588363264:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432568.346514:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:2401:x1874258588363264:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432568.346520:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 344 00000100:00100000:3.0:1787432568.347241:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588363648 00000100:00100000:3.0:1787432568.347247:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588363648 00000100:00100000:3.0:1787432568.347315:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 67 00000100:00100000:3.0:1787432568.347325:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588363648:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432568.347553:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588363648:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 230us (1729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432568.347562:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 67 00000100:00080000:2.0:1787432568.347800:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787432569.035663:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787432569.582845:0:13696:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:0.0:1787432569.807269:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1787432569.808026:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1787432569.808046:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787432569.808200:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609419904:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787432569.808272:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432569.808883:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609419904 00000100:00100000:1.0:1787432569.808893:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609419904 00000100:00100000:1.0:1787432569.808975:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787432569.808987:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609419904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787432569.809029:0:8806:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1787432569.809064:0:8806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a8a0e74, atime: 0x6a8a0e74, ctime: 0x6a8a0e74, blocks: 0x0 00010000:00010000:1.0:1787432569.809072:0:8806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b33563ee0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432569.809089:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1787432569.809094:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432569.809100:0:8806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b33563ee0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432569.809118:0:8806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b33563ee0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432569.809129:0:8806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b33563ee0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432569.809137:0:8806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b33563ee0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787432569.809137:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787432569.809186:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432569.809187:0:8806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787432569.809193:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b33563ee0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.809201:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432569.809205:0:9519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b33563ee0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.809213:0:9519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b33563ee0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.809232:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b33563ee0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.809239:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b33563ee0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.809256:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432569.809258:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432569.809260:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432569.809359:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1874258609419904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 375us (1086us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787432569.809366:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1787432569.809619:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff948303b38000/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787432569.809627:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609419904:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787432569.812918:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.812957:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed64 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.812973:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.812979:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432569.812984:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.812992:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed64 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813010:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb4e9f8bc (ffff948435957b00) 00010000:00010000:2.0:1787432569.813013:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432569.813018:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed64 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813024:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ed64 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813050:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ed79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813057:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ed79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813063:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ed79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813068:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851a00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432569.813077:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ed79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813084:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ed79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813093:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff94841318b800) 00010000:00010000:2.0:1787432569.813095:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432569.813098:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ed79 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813115:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ed79 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813157:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563ede2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813180:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563ede2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813186:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563ede2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813191:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400031600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432569.813194:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563ede2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813200:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563ede2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813207:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb4e9f8bc (ffff948435957b00) 00010000:00010000:2.0:1787432569.813210:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432569.813220:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563ede2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813225:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563ede2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb4e9f8bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813245:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ea00/0xca72b3b33563edfe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813251:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ea00/0xca72b3b33563edfe lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813257:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ea00/0xca72b3b33563edfe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813261:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94840149ea00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432569.813264:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ea00/0xca72b3b33563edfe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813270:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ea00/0xca72b3b33563edfe lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813277:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff948435915e00) 00010000:00010000:2.0:1787432569.813280:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432569.813282:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ea00/0xca72b3b33563edfe lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.813287:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ea00/0xca72b3b33563edfe lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.059512:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432570.827387:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609420032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432570.827490:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432570.827583:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609420032 00000100:00100000:1.0:1787432570.827601:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609420032 00000100:00100000:1.0:1787432570.827661:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787432570.827670:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609420032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432570.827698:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432570.827740:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609420032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432570.827747:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1787432570.827765:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787432570.827818:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303b39500 x1874258609420032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432570.827836:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609420032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432570.830271:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609420160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432570.830334:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432570.830395:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609420160 00000100:00100000:1.0:1787432570.830403:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609420160 00000100:00100000:1.0:1787432570.830446:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787432570.830455:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609420160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787432570.830487:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787432570.830529:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609420160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432570.830536:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787432570.830578:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609420160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432570.838318:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432570.838343:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609420288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787432570.838415:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432570.838472:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609420288 00000100:00100000:3.0:1787432570.838479:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609420288 00000100:00100000:3.0:1787432570.838532:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787432570.838541:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609420288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787432570.838564:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432570.838611:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609420288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432570.838619:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1787432570.838640:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787432570.838663:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483038c5880 x1874258609420288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432570.838682:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609420288:0@lo:13:osp-pre-0-1.0 00000020:00000080:1.0:1787432570.960755:0:13744:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf515dd70 20000000:00000080:1.0:1787432570.960777:0:13744:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff948303b72000 uarg=0000000000000000 20000000:01000000:1.0:1787432570.960826:0:13744:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787432570.960833:0:13744:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787432570.960844:0:13744:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787432570.961419:0:13745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787432570.961576:0:13744:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787432570.966600:0:13744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787432570.966638:0:13744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787432570.966651:0:13744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787432570.966667:0:13744:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787432570.966689:0:13744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948303850800/0xca72b3b33563ee13 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.966708:0:13744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948400030c00/0xca72b3b33563eca0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ec99 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.966716:0:13744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948303850200/0xca72b3b33563ecae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563eca7 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.966723:0:13744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948400030200/0xca72b3b33563ecbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ecb5 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.966729:0:13744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948303850600/0xca72b3b33563ecca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ecc3 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.966815:0:13744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948303012200/0xca72b3b33563ecd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cea expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.966982:0:13744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948303013c00/0xca72b3b33563ecd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cf1 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.966990:0:13744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948303850800/0xca72b3b33563ee13 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.967143:0:13744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948303013c00/0xca72b3b33563ecd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cf1 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.967941:0:13744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948303013c00/0xca72b3b33563ecd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cf1 expref: 12 pid: 6506 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432570.967958:0:13744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1874258609420416:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432570.968467:0:13744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948303012200/0xca72b3b33563ecd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cea expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432570.968490:0:13744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948303012200/0xca72b3b33563ecd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cea expref: 12 pid: 6506 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432570.968501:0:13744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1874258609420544:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432570.968538:0:13744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948303850600/0xca72b3b33563ecca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563ecc3 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432570.968547:0:13744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948303850600/0xca72b3b33563ecca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563ecc3 expref: 23 pid: 6507 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432570.968557:0:13744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1874258609420672:0@lo:104: 00000100:00100000:0.0:1787432570.968603:0:13744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432570.968648:0:13744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948400030200/0xca72b3b33563ecbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563ecb5 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432570.968657:0:13744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948400030200/0xca72b3b33563ecbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563ecb5 expref: 23 pid: 6507 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432570.968664:0:13744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1874258609420800:0@lo:104: 00010000:00010000:0.0:1787432570.968688:0:13744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948303850200/0xca72b3b33563ecae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563eca7 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432570.968695:0:13744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948303850200/0xca72b3b33563ecae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563eca7 expref: 23 pid: 6508 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432570.968720:0:13744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1874258609420928:0@lo:104: 00010000:00010000:0.0:1787432570.968749:0:13744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948400030c00/0xca72b3b33563eca0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563ec99 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432570.968757:0:13744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff948400030c00/0xca72b3b33563eca0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563ec99 expref: 23 pid: 6508 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432570.968764:0:13744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1874258609421056:0@lo:104: 00000100:00100000:0.0:1787432570.968783:0:13744:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d319c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432570.969073:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787432570.969099:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432570.969137:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432570.969151:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432570.969160:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609420672 00000100:00100000:2.0:1787432570.969197:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609420672 00000100:00100000:2.0:1787432570.969245:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609420800 00000100:00100000:2.0:1787432570.969248:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609420800 00000100:00100000:2.0:1787432570.969260:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609420928 00000100:00100000:2.0:1787432570.969263:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609420928 00000100:00100000:2.0:1787432570.969272:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609421056 00000100:00100000:2.0:1787432570.969274:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609421056 00000100:00100000:2.0:1787432570.969288:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787432570.969296:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f92c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+6:13744:x1874258609420672:12345-0@lo:104: 00010000:00010000:2.0:1787432570.969310:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b33563ecc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ecca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.969365:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787432570.969373:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f92c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+6:13744:x1874258609420672:12345-0@lo:104: Request processed in 77us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432570.969380:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787432570.969424:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787432570.969431:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+5:13744:x1874258609420800:12345-0@lo:104: 00010000:00010000:2.0:1787432570.969439:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b33563ecb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ecbc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.969475:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787432570.969498:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+5:13744:x1874258609420800:12345-0@lo:104: Request processed in 67us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432570.969504:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787432570.969517:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787432570.969531:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:13744:x1874258609420928:12345-0@lo:104: 00010000:00010000:2.0:1787432570.969539:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b33563eca7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ecae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.969574:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787432570.969579:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+4:13744:x1874258609420928:12345-0@lo:104: Request processed in 51us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432570.969586:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787432570.969599:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787432570.969606:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:13744:x1874258609421056:12345-0@lo:104: 00010000:00010000:2.0:1787432570.969614:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948303851c00/0xca72b3b33563ec99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563eca0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.969640:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787432570.969645:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+3:13744:x1874258609421056:12345-0@lo:104: Request processed in 41us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432570.969652:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1787432570.969669:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787432570.969675:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b33563ecc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ecca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.969683:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432570.969688:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b33563ecc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563ecca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.969696:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b33563ecc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563ecca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432570.969703:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b33563ecc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563ecca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432570.969716:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787432570.969747:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b33563ecc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ecca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.969754:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432570.969774:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b33563ecc3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ecca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.969782:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff94843f85e400/0xca72b3b33563ecc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ecca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.969797:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787432570.969800:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b33563ecb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ecbc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.969806:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e800 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432570.969809:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b33563ecb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563ecbc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.969870:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b33563ecb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563ecbc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432570.969877:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b33563ecb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563ecbc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432570.969883:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787432570.969897:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b33563ecb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ecbc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.969903:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432570.969923:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b33563ecb5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ecbc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.969930:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b33563ecb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ecbc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.969940:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787432570.969943:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b33563eca7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ecae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.969950:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ea00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432570.969953:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b33563eca7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563ecae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.969960:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b33563eca7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563ecae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432570.969966:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b33563eca7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563ecae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432570.969972:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787432570.969986:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b33563eca7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ecae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.969992:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432570.969997:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b33563eca7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ecae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.970003:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff94843f85ea00/0xca72b3b33563eca7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ecae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.970011:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432570.970020:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948303851c00/0xca72b3b33563ec99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563eca0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.970026:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851c00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432570.970029:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948303851c00/0xca72b3b33563ec99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563eca0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.970035:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948303851c00/0xca72b3b33563ec99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563eca0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432570.970041:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948303851c00/0xca72b3b33563ec99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563eca0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432570.970046:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787432570.970060:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948303851c00/0xca72b3b33563ec99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563eca0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.970066:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432570.970072:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948303851c00/0xca72b3b33563ec99 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563eca0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.970077:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948303851c00/0xca72b3b33563ec99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563eca0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.970089:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432570.970091:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432570.970093:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432570.970100:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432570.970114:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609421184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432570.970161:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432570.970213:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432570.970227:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609421568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432570.970252:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432570.970282:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609421184 00000100:00100000:2.0:1787432570.970287:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609421184 00010000:00010000:2.0:1787432570.970309:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948303850600/0xca72b3b33563ecca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ecc3 expref: 24 pid: 6507 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432570.970331:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609421568 00000100:00100000:2.0:1787432570.970334:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609421568 00010000:00010000:2.0:1787432570.970345:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948400030c00/0xca72b3b33563eca0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ec99 expref: 25 pid: 6508 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432570.970362:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787432570.970369:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+25:3644:x1874258609421184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432570.970381:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432570.970387:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948303850600/0xca72b3b33563ecca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ecc3 expref: 25 pid: 6507 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.970398:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948303850600/0xca72b3b33563ecca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563ecc3 expref: 25 pid: 6507 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.970415:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432570.970442:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+25:3644:x1874258609421184:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432570.970448:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787432570.970463:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787432570.970469:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3644:x1874258609421568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432570.970477:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432570.970481:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948400030c00/0xca72b3b33563eca0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ec99 expref: 24 pid: 6508 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.970497:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948400030c00/0xca72b3b33563eca0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563ec99 expref: 24 pid: 6508 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.970507:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432570.970530:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3644:x1874258609421568:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432570.970535:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787432570.970570:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609421568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432570.970577:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609421184:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432570.970673:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432570.970688:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609421312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432570.970718:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432570.970752:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432570.970758:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609421440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432570.970779:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432570.970802:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609421312 00000100:00100000:1.0:1787432570.970806:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609421312 00010000:00010000:1.0:1787432570.970822:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948400030200/0xca72b3b33563ecbc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ecb5 expref: 24 pid: 6507 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432570.970837:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609421440 00000100:00100000:1.0:1787432570.970840:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609421440 00010000:00010000:1.0:1787432570.970849:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948303850200/0xca72b3b33563ecae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563eca7 expref: 25 pid: 6508 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432570.970860:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787432570.970865:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+25:3641:x1874258609421312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432570.970872:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432570.970876:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948400030200/0xca72b3b33563ecbc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ecb5 expref: 25 pid: 6507 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.970883:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948400030200/0xca72b3b33563ecbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563ecb5 expref: 25 pid: 6507 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.970900:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432570.970928:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+25:3641:x1874258609421312:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432570.970934:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787432570.970954:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787432570.970961:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3641:x1874258609421440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432570.970968:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432570.970972:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948303850200/0xca72b3b33563ecae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563eca7 expref: 24 pid: 6508 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.970980:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948303850200/0xca72b3b33563ecae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563eca7 expref: 24 pid: 6508 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.970989:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432570.971008:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3641:x1874258609421440:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432570.971014:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787432570.971036:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609421440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432570.971042:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609421312:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432570.971072:0:13744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303850600/0xca72b3b33563ecca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563ecc3 expref: 23 pid: 6507 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432570.971082:0:13744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1874258609420672:0@lo:104: 00010000:00010000:1.0:1787432570.971090:0:13744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948400030200/0xca72b3b33563ecbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563ecb5 expref: 22 pid: 6507 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432570.971109:0:13744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1874258609420800:0@lo:104: 00010000:00010000:1.0:1787432570.971118:0:13744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303850200/0xca72b3b33563ecae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563eca7 expref: 21 pid: 6508 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432570.971137:0:13744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1874258609420928:0@lo:104: 00010000:00010000:1.0:1787432570.971146:0:13744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948400030c00/0xca72b3b33563eca0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563ec99 expref: 20 pid: 6508 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432570.971153:0:13744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1874258609421056:0@lo:104: 00000100:00100000:3.0:1787432570.973365:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432570.973434:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432570.973735:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588364032 00000100:00100000:3.0:1787432570.973745:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588364032 00010000:00010000:3.0:1787432570.973790:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948303013c00/0xca72b3b33563ecd8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cf1 expref: 13 pid: 6506 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432570.973814:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588364160 00000100:00100000:3.0:1787432570.973817:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588364160 00010000:00010000:3.0:1787432570.973841:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948303012200/0xca72b3b33563ecd1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cea expref: 14 pid: 6506 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432570.973856:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 50 00000100:00100000:3.0:1787432570.973866:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a40dc378-0ae8-4eb1-a992-02a683490593+14:2403:x1874258588364032:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432570.973882:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432570.973888:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948303013c00/0xca72b3b33563ecd8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cf1 expref: 14 pid: 6506 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.973901:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948303013c00/0xca72b3b33563ecd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cf1 expref: 14 pid: 6506 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.973921:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432570.973968:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a40dc378-0ae8-4eb1-a992-02a683490593+14:2403:x1874258588364032:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 103us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432570.973975:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 50 00000100:00100000:3.0:1787432570.973993:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 51 00000100:00100000:3.0:1787432570.974000:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a40dc378-0ae8-4eb1-a992-02a683490593+13:2403:x1874258588364160:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432570.974009:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432570.974014:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948303012200/0xca72b3b33563ecd1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cea expref: 13 pid: 6506 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.974032:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948303012200/0xca72b3b33563ecd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cea expref: 13 pid: 6506 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.974045:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948303850800/0xca72b3b33563ee13 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.974052:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303850800/0xca72b3b33563ee13 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.974067:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948303850800/0xca72b3b33563ee13 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.974073:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948303850800/0xca72b3b33563ee13 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.976112:0:13744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303013c00/0xca72b3b33563ecd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cf1 expref: 13 pid: 6506 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432570.976148:0:13744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1874258609420416:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432570.976181:0:13744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303012200/0xca72b3b33563ecd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cea expref: 12 pid: 6506 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432570.976191:0:13744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1874258609420544:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432570.976293:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948303850800/0xca72b3b33563ee13 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.976303:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948303850800/0xca72b3b33563ee13 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.976876:0:13744:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948303850800/0xca72b3b33563ee13 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.976891:0:13744:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff948303850800/0xca72b3b33563ee13 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.976898:0:13744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948303850800/0xca72b3b33563ee13 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.979298:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850800 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432570.979311:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948303850800/0xca72b3b33563ee13 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.979325:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948303850800/0xca72b3b33563ee13 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.979342:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948303850800/0xca72b3b33563ee13 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.979364:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303850800/0xca72b3b33563ee13 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.979578:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432570.979663:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a40dc378-0ae8-4eb1-a992-02a683490593+11:2403:x1874258588364160:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 5657us (6221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432570.979677:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 51 00010000:00010000:2.0:1787432571.085052:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432571.339534:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609421696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432571.339629:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432571.339761:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609421696 00000100:00100000:1.0:1787432571.339786:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609421696 00000100:00100000:1.0:1787432571.340019:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787432571.340030:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609421696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787432571.340066:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432571.340135:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609421696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432571.340143:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787432571.340229:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609421824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432571.340258:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432571.341105:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609421952:0@lo:400:kworker.0 00000100:00100000:1.0:1787432571.341184:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432571.341208:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609422464:0@lo:400:kworker.0 00000100:00100000:1.0:1787432571.341235:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432571.341251:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609422976:0@lo:400:kworker.0 00000100:00100000:1.0:1787432571.341272:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432571.341292:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787432571.341297:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609422336:0@lo:400:kworker.0 00000100:00100000:1.0:1787432571.341325:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432571.341344:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609422848:0@lo:400:kworker.0 00000100:00100000:1.0:1787432571.341365:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432571.341416:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609421952 00000100:00100000:1.0:1787432571.341422:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609421952 00000100:00100000:1.0:1787432571.341460:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609422464 00000100:00100000:1.0:1787432571.341463:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609422464 00000100:00100000:0.0:1787432571.341546:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609422080:0@lo:400:kworker.0 00000100:00100000:0.0:1787432571.341577:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432571.341600:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609422592:0@lo:400:kworker.0 00000100:00100000:0.0:1787432571.341621:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432571.341638:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609423104:0@lo:400:kworker.0 00000100:00100000:0.0:1787432571.341656:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432571.341669:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787432571.341674:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609422208:0@lo:400:kworker.0 00000100:00100000:0.0:1787432571.341692:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432571.341702:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609422720:0@lo:400:kworker.0 00000100:00100000:0.0:1787432571.341718:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432571.341753:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609422976 00000100:00100000:0.0:1787432571.341757:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609422976 00000100:00080000:3.0:1787432571.343701:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432571.343711:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432571.344941:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609421824 00000100:00100000:2.0:1787432571.344953:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609421824 00000100:00100000:2.0:1787432571.345029:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787432571.345041:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609421824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432571.345065:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432571.345158:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609421824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (4898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432571.345189:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787432571.345252:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609421696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432571.345297:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609422336 00000100:00100000:2.0:1787432571.345302:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609422336 00000100:00100000:2.0:1787432571.345331:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609422080 00000100:00100000:2.0:1787432571.345334:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609422080 00000100:00100000:2.0:1787432571.345348:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1787432571.345592:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432571.346240:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609422592 00000100:00100000:3.0:1787432571.346248:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609422592 00000100:00100000:3.0:1787432571.346289:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609423104 00000100:00100000:3.0:1787432571.346292:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609423104 00000100:00100000:3.0:1787432571.346307:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609422208 00000100:00100000:3.0:1787432571.346310:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609422208 00000100:00100000:3.0:1787432571.346323:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787432571.346331:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609421952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432571.346533:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609421952:12345-0@lo:400:kworker.0 Request processed in 202us (5368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432571.346541:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787432571.346557:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787432571.346563:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609422592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432571.346602:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609422592:12345-0@lo:400:kworker.0 Request processed in 40us (4979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432571.346624:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787432571.346637:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787432571.346642:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609423104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432571.346668:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609423104:12345-0@lo:400:kworker.0 Request processed in 26us (5011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432571.346672:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787432571.346681:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787432571.346687:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609422208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432571.346709:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609422208:12345-0@lo:400:kworker.0 Request processed in 23us (5016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432571.346713:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787432571.347721:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609422848 00000100:00100000:1.0:1787432571.347876:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787432571.347891:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609422080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432571.347979:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609422080:12345-0@lo:400:kworker.0 Request processed in 93us (6400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432571.347987:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787432571.348066:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609421952:0@lo:400:kworker.0 00000100:00100000:1.0:1787432571.348145:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787432571.348154:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609422464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432571.348207:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609422464:12345-0@lo:400:kworker.0 Request processed in 56us (6972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432571.348213:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787432571.348239:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609422464:0@lo:400:kworker.0 00000100:00100000:2.0:1787432571.349190:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609422336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432571.349281:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609422336:12345-0@lo:400:kworker.0 Request processed in 3926us (7955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432571.349290:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787432571.349539:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609422336:0@lo:400:kworker.0 00000100:00100000:0.0:1787432571.349652:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609422208:0@lo:400:kworker.0 00000100:00100000:0.0:1787432571.349667:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609422080:0@lo:400:kworker.0 00010000:00080000:0.0:1787432571.349693:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303bc3480 x1874258609422592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432571.349703:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609422592:0@lo:400:kworker.0 00010000:00080000:0.0:1787432571.349714:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303bc3800 x1874258609423104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432571.349722:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609423104:0@lo:400:kworker.0 00000100:00100000:0.0:1787432571.349903:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609422720 00000100:00100000:0.0:1787432571.349910:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609422720 00000100:00100000:0.0:1787432571.349951:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787432571.349959:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609422720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432571.350006:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609422720:12345-0@lo:400:kworker.0 Request processed in 48us (8286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432571.350011:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1787432571.350037:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303bc0000 x1874258609422720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432571.350047:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609422720:0@lo:400:kworker.0 00000100:00100000:0.0:1787432571.350077:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787432571.350083:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609422976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432571.350115:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609422976:12345-0@lo:400:kworker.0 Request processed in 32us (8841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432571.350130:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787432571.350206:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609422848 00000100:00100000:3.0:1787432571.350236:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787432571.350242:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609422848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432571.350275:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609422848:12345-0@lo:400:kworker.0 Request processed in 33us (8909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432571.350281:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787432571.350324:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609421824:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787432571.350341:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787432571.350597:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303bc2d80 x1874258609422848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432571.350608:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609422848:0@lo:400:kworker.0 00000100:00100000:1.0:1787432571.350618:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609422976:0@lo:400:kworker.0 00000020:00000080:0.0:1787432571.952977:0:13793:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9b362430 20000000:00000080:0.0:1787432571.952996:0:13793:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff948303b62800 uarg=0000000000000000 20000000:01000000:0.0:1787432571.953042:0:13793:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1787432571.953055:0:13793:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1787432571.953060:0:13793:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1787432571.953912:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1787432571.954089:0:13793:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1787432571.954473:0:13793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1787432571.954510:0:13793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1787432571.954528:0:13793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1787432571.954543:0:13793:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787432571.954567:0:13793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94840149ec00/0xca72b3b33563ee1a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432571.954586:0:13793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94840149ec00/0xca72b3b33563ee1a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432571.954596:0:13793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94840149ec00/0xca72b3b33563ee1a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432571.954603:0:13793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94840149ec00/0xca72b3b33563ee1a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432571.954609:0:13793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94840149ec00/0xca72b3b33563ee1a lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432571.954615:0:13793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94840149ec00/0xca72b3b33563ee1a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432571.954621:0:13793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94840149ec00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432571.954625:0:13793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94840149ec00/0xca72b3b33563ee1a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432571.954632:0:13793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94840149ec00/0xca72b3b33563ee1a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432571.954660:0:13793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94840149ec00/0xca72b3b33563ee1a lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432571.954667:0:13793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94840149ec00/0xca72b3b33563ee1a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432571.954672:0:13793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94840149ec00/0xca72b3b33563ee1a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432572.107961:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787432572.302594:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787432572.302603:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948435bcb800 from 7 10000000:01000000:1.0:1787432572.302609:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787432572.302663:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303850a00/0xca72b3b33563ee21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432572.302676:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948303850a00/0xca72b3b33563ee21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432572.302688:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948303850a00/0xca72b3b33563ee21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432572.302725:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609423232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787432572.302791:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432572.302839:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358e1840 going to sleep for 11 seconds 00000100:00100000:3.0:1787432572.303631:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609423232 00000100:00100000:3.0:1787432572.303641:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609423232 00000100:00100000:3.0:1787432572.303705:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787432572.303717:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:6511:x1874258609423232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432572.303733:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432572.303757:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303013000/0xca72b3b33563ee28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ee21 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432572.303782:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303013000/0xca72b3b33563ee28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ee21 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432572.303793:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303013000/0xca72b3b33563ee28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ee21 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432572.303802:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303013000, rc 0) 00000100:00100000:3.0:1787432572.303866:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609423232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432572.303873:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787432572.304298:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609423232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432572.304317:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948303850a00/0xca72b3b33563ee21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ee28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432572.304327:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948303850a00/0xca72b3b33563ee21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ee28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432572.304972:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609423360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432572.305021:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432572.305077:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432572.305315:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609423360 00000100:00100000:3.0:1787432572.305321:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609423360 00000100:00100000:3.0:1787432572.305368:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787432572.305486:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609423360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432572.305942:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609423360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 459us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432572.305949:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1787432572.309365:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609423360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432572.309800:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609423488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432572.309909:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432572.309963:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484052ecc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432572.310029:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609423488 00000100:00100000:1.0:1787432572.310037:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609423488 00000100:00100000:1.0:1787432572.310127:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1787432572.310138:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609423488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432572.310296:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609423488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432572.310304:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1787432572.310481:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609423488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432572.310974:0:13806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:13806:1874258609423616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432572.311024:0:13806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432572.311063:0:13806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483030709c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432572.311128:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609423616 00000100:00100000:1.0:1787432572.311133:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609423616 00000100:00100000:1.0:1787432572.311193:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1787432572.311207:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:13806:x1874258609423616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432572.311303:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:13806:x1874258609423616:12345-0@lo:502:llog_process_th.0 Request processed in 103us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432572.311310:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1787432572.311372:0:13806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:13806:1874258609423616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432572.311400:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432572.311409:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432572.311412:0:13806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787432572.311419:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948435bcb800 00000020:00000080:2.0:1787432572.311421:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787432572.311491:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432572.311496:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432572.311497:0:13806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787432572.311500:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432572.311503:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432572.311504:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787432572.311508:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948435bcb800 00000020:00000080:2.0:1787432572.311518:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787432572.311570:0:13806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:13806:1874258609423744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432572.311616:0:13806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432572.312211:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609423744 00000100:00100000:2.0:1787432572.312216:0:13806:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432572.312217:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609423744 00000100:00100000:0.0:1787432572.312256:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787432572.312264:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:13806:x1874258609423744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432572.312494:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:13806:x1874258609423744:12345-0@lo:502:llog_process_th.0 Request processed in 229us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432572.312501:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1787432572.312750:0:13806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:13806:1874258609423744:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432572.312775:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432572.312780:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432572.312782:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787432572.312785:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787432572.315486:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787432572.315528:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787432572.315541:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303850a00/0xca72b3b33563ee21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ee28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432572.315555:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948303850a00/0xca72b3b33563ee21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ee28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432572.315576:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787432572.315579:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948435a21000 from 7 10000000:01000000:0.0:1787432572.315582:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787432572.315621:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94840149e000/0xca72b3b33563ee2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432572.315628:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94840149e000/0xca72b3b33563ee2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432572.315640:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94840149e000/0xca72b3b33563ee2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432572.315664:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609423872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787432572.315735:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432572.315790:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483030703c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432572.316076:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609423872 00000100:00100000:1.0:1787432572.316085:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609423872 00000100:00100000:1.0:1787432572.316151:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1787432572.316182:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:6511:x1874258609423872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432572.316198:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432572.316214:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303851200/0xca72b3b33563ee36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ee2f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432572.316250:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303851200/0xca72b3b33563ee36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ee2f expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432572.316262:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303851200/0xca72b3b33563ee36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ee2f expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432572.316273:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851200, rc 0) 00000100:00100000:1.0:1787432572.316323:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609423872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432572.316330:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787432572.316925:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609423872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432572.316944:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94840149e000/0xca72b3b33563ee2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ee36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432572.316955:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94840149e000/0xca72b3b33563ee2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ee36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432572.317031:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609424000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432572.317069:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432572.317145:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432572.317261:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609424000 00000100:00100000:1.0:1787432572.317266:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609424000 00000100:00100000:1.0:1787432572.317296:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787432572.317304:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609424000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432572.317477:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609424000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432572.317484:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787432572.317535:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609424000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432572.317567:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609424128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432572.317608:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432572.317632:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948418e07f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432572.317723:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609424128 00000100:00100000:0.0:1787432572.317728:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609424128 00000100:00100000:0.0:1787432572.317763:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1787432572.317769:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609424128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432572.317855:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609424128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432572.317862:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1787432572.317962:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609424128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432572.318507:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:13808:1874258609424256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432572.318553:0:13808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432572.318633:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303070f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432572.318720:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609424256 00000100:00100000:1.0:1787432572.318725:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609424256 00000100:00100000:1.0:1787432572.318768:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1787432572.318777:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:13808:x1874258609424256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432572.318871:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:13808:x1874258609424256:12345-0@lo:502:llog_process_th.0 Request processed in 96us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432572.318878:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787432572.318959:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:13808:1874258609424256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787432572.318986:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432572.318996:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432572.318998:0:13808:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787432572.319007:0:13808:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948435a21000 00000020:00000080:0.0:1787432572.319010:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787432572.319075:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432572.319080:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432572.319081:0:13808:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787432572.319085:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432572.319088:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432572.319089:0:13808:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787432572.319093:0:13808:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948435a21000 00000020:00000080:0.0:1787432572.319095:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787432572.319158:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:13808:1874258609424384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432572.319218:0:13808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432572.319233:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303070f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432572.319288:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609424384 00000100:00100000:2.0:1787432572.319292:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609424384 00000100:00100000:2.0:1787432572.319322:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787432572.319330:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:13808:x1874258609424384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432572.319405:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:13808:x1874258609424384:12345-0@lo:502:llog_process_th.0 Request processed in 75us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432572.319421:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787432572.320364:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:13808:1874258609424384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787432572.320395:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432572.320402:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432572.320404:0:13808:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787432572.320408:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787432572.323454:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787432572.323498:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787432572.323511:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94840149e000/0xca72b3b33563ee2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ee36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432572.323524:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94840149e000/0xca72b3b33563ee2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ee36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432572.323537:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787432572.323540:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94842dfc5000 from 7 10000000:01000000:1.0:1787432572.323543:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787432572.323581:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303850c00/0xca72b3b33563ee3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432572.323589:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948303850c00/0xca72b3b33563ee3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432572.323601:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948303850c00/0xca72b3b33563ee3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432572.323627:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609424512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787432572.324427:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432572.324525:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484126b6780 going to sleep for 11 seconds 00000100:00100000:2.0:1787432572.330182:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609424512 00000100:00100000:2.0:1787432572.330198:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609424512 00000100:00100000:2.0:1787432572.330272:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787432572.330286:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:6511:x1874258609424512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432572.330307:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432572.330597:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94843f85f400/0xca72b3b33563ee44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ee3d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432572.330628:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94843f85f400/0xca72b3b33563ee44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ee3d expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432572.330641:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94843f85f400/0xca72b3b33563ee44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ee3d expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432572.330650:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85f400, rc 0) 00000100:00100000:2.0:1787432572.330859:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609424512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 576us (6434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432572.330867:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787432572.330913:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609424512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432572.330936:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948303850c00/0xca72b3b33563ee3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ee44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432572.330947:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948303850c00/0xca72b3b33563ee3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ee44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432572.331039:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609424640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432572.331110:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432572.331136:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609424640 00000100:00100000:2.0:1787432572.331142:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609424640 00000100:00100000:1.0:1787432572.331147:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484126b6780 going to sleep for 11 seconds 00000100:00100000:2.0:1787432572.331196:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787432572.331205:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609424640:12345-0@lo:501:ll_cfg_requeue.0 00000040:00080000:0.0:1787432572.339992:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787432572.341768:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609424640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 10551us (10645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432572.341787:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787432572.342472:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609424640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432572.342541:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609424768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432572.342619:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432572.342868:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484126b6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787432572.342944:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609424768 00000100:00100000:0.0:1787432572.342952:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609424768 00000100:00100000:0.0:1787432572.343011:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787432572.343022:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609424768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432572.343199:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609424768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432572.343215:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787432572.343387:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609424768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432572.347113:0:13812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:13812:1874258609424896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432572.347241:0:13812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432572.347288:0:13812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432572.347412:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609424896 00000100:00100000:0.0:1787432572.347422:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609424896 00000100:00100000:0.0:1787432572.347490:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1787432572.347503:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:13812:x1874258609424896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432572.347665:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:13812:x1874258609424896:12345-0@lo:502:llog_process_th.0 Request processed in 164us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432572.347675:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787432572.347764:0:13812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:13812:1874258609424896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787432572.347803:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432572.347815:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432572.347818:0:13812:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787432572.347830:0:13812:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94842dfc5000 00000020:00000080:3.0:1787432572.347839:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787432572.347920:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432572.347925:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432572.347927:0:13812:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787432572.347931:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432572.347934:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432572.347936:0:13812:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787432572.347941:0:13812:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94842dfc5000 00000020:00000080:3.0:1787432572.347944:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787432572.347984:0:13812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:13812:1874258609425024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432572.348030:0:13812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432572.348066:0:13812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484052ecf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432572.348443:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609425024 00000100:00100000:1.0:1787432572.348449:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609425024 00000100:00100000:1.0:1787432572.348488:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787432572.351513:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:13812:x1874258609425024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432572.351717:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:13812:x1874258609425024:12345-0@lo:502:llog_process_th.0 Request processed in 227us (3685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432572.351728:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1787432572.351777:0:13812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:13812:1874258609425024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432572.351819:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432572.351828:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432572.351831:0:13812:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787432572.351836:0:13812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787432572.352340:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787432572.352364:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787432572.352376:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303850c00/0xca72b3b33563ee3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ee44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432572.352388:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948303850c00/0xca72b3b33563ee3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ee44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432572.352399:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787432572.352408:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948411b1c000 from 7 10000000:01000000:1.0:1787432572.352412:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787432572.352450:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303851800/0xca72b3b33563ee4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432572.352460:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948303851800/0xca72b3b33563ee4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432572.352470:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948303851800/0xca72b3b33563ee4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432572.352492:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609425152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787432572.352534:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432572.352580:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484126b69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432572.352796:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609425152 00000100:00100000:0.0:1787432572.352803:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609425152 00000100:00100000:0.0:1787432572.352857:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787432572.352867:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:6511:x1874258609425152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432572.352877:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432572.352889:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94840149fa00/0xca72b3b33563ee52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ee4b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432572.352911:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94840149fa00/0xca72b3b33563ee52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ee4b expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432572.352921:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94840149fa00/0xca72b3b33563ee52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ee4b expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432572.352929:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94840149fa00, rc 0) 00000100:00100000:0.0:1787432572.352978:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609425152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432572.352985:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1787432572.354989:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609425152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432572.355022:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948303851800/0xca72b3b33563ee4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ee52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432572.355038:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948303851800/0xca72b3b33563ee4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ee52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432572.355150:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609425280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432572.355235:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432572.355284:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432572.355761:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609425280 00000100:00100000:1.0:1787432572.355769:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609425280 00000100:00100000:1.0:1787432572.355831:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1787432572.355843:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609425280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432572.356009:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609425280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432572.356017:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787432572.356077:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609425280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432572.356134:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609425408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432572.356207:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432572.356239:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432572.356326:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609425408 00000100:00100000:1.0:1787432572.356331:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609425408 00000100:00100000:1.0:1787432572.356370:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787432572.356377:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609425408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432572.356469:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:6511:x1874258609425408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432572.356476:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1787432572.356496:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d0f84c3f-71b4-4eda-b290-0af337217d3a:6511:1874258609425408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432572.357319:0:13813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:13813:1874258609425536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432572.357377:0:13813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432572.358272:0:13813:0:(client.c:2715:ptlrpc_set_wait()) set ffff948406162300 going to sleep for 11 seconds 00000100:00100000:0.0:1787432572.358476:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609425536 00000100:00100000:0.0:1787432572.358489:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609425536 00000100:00100000:0.0:1787432572.358544:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1787432572.358556:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:13813:x1874258609425536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432572.358807:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:13813:x1874258609425536:12345-0@lo:502:llog_process_th.0 Request processed in 254us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432572.358815:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787432572.359014:0:13813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:13813:1874258609425536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787432572.359048:0:13813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432572.359059:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432572.359347:0:13813:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787432572.359360:0:13813:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948411b1c000 00000020:00000080:1.0:1787432572.359363:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787432572.359435:0:13813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432572.359439:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432572.359440:0:13813:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787432572.359443:0:13813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432572.359446:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432572.359448:0:13813:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787432572.359452:0:13813:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948411b1c000 00000020:00000080:1.0:1787432572.359454:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787432572.359501:0:13813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:13813:1874258609425664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432572.359551:0:13813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432572.359619:0:13813:0:(client.c:2715:ptlrpc_set_wait()) set ffff948406162300 going to sleep for 11 seconds 00000100:00100000:0.0:1787432572.359742:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609425664 00000100:00100000:0.0:1787432572.359747:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609425664 00000100:00100000:0.0:1787432572.359826:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787432572.359836:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433646050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:13813:x1874258609425664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432572.359946:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433646050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:13813:x1874258609425664:12345-0@lo:502:llog_process_th.0 Request processed in 111us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432572.359954:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787432572.360255:0:13813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d0f84c3f-71b4-4eda-b290-0af337217d3a:13813:1874258609425664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787432572.360275:0:13813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432572.360280:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432572.360282:0:13813:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787432572.360286:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787432572.360418:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787432572.360461:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432572.360473:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303851800/0xca72b3b33563ee4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ee52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432572.360492:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948303851800/0xca72b3b33563ee4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ee52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787432572.383042:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787432572.383351:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432572.383408:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588364288 00000100:00100000:0.0:1787432572.383422:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588364288 00000100:00100000:0.0:1787432572.383482:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 365 00000100:00100000:0.0:1787432572.383496:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+11:6175:x1874258588364288:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432572.383516:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432572.383537:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94840149ea00/0xca72b3b33563ee59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d3e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432572.383579:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94840149ea00/0xca72b3b33563ee59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d3e expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432572.383592:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94840149ea00/0xca72b3b33563ee59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d3e expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432572.383602:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94840149ea00, rc 0) 00000100:00100000:0.0:1787432572.383681:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433645050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+12:6175:x1874258588364288:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 187us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432572.383688:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 365 00000100:00100000:1.0:1787432572.397789:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432572.398452:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588364416 00000100:00100000:3.0:1787432572.398462:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588364416 00000100:00100000:3.0:1787432572.398539:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 366 00000100:00100000:3.0:1787432572.398551:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+12:6175:x1874258588364416:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432572.398713:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433647050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+12:6175:x1874258588364416:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 162us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432572.398723:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 366 00000100:00100000:3.0:1787432572.402509:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432572.402572:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588364544 00000100:00100000:1.0:1787432572.402583:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588364544 00000100:00100000:1.0:1787432572.402652:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 367 00000100:00100000:1.0:1787432572.402677:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433644850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+12:6175:x1874258588364544:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432572.402864:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433644850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+12:6175:x1874258588364544:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 Request processed in 189us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432572.402873:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 367 00000100:00100000:1.0:1787432572.412688:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432572.412769:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588364672 00000100:00100000:0.0:1787432572.412781:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588364672 00000100:00100000:0.0:1787432572.412843:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 368 00000100:00100000:0.0:1787432572.412854:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+12:10822:x1874258588364672:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787432572.413061:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+12:10822:x1874258588364672:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 207us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432572.413071:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 368 00000100:00100000:3.0:1787432572.425036:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432572.425155:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588364800 00000100:00100000:2.0:1787432572.425194:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588364800 00000100:00100000:2.0:1787432572.425250:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 369 00000100:00100000:2.0:1787432572.425263:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948406122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+12:10822:x1874258588364800:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787432572.425427:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948406122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+12:10822:x1874258588364800:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 166us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432572.425435:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 369 00000100:00100000:2.0:1787432572.430715:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432572.430764:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588364928 00000100:00100000:3.0:1787432572.430774:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588364928 00000100:00100000:3.0:1787432572.430826:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 370 00000100:00100000:3.0:1787432572.430837:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948406120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+12:6175:x1874258588364928:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432572.430853:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432572.430870:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303012600/0xca72b3b33563ee60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d45 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432572.430918:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303012600/0xca72b3b33563ee60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d45 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432572.430930:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303012600/0xca72b3b33563ee60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d45 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432572.430940:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303012600, rc 0) 00000100:00100000:3.0:1787432572.431008:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948406120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:6175:x1874258588364928:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 172us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432572.431015:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 370 00000100:00100000:0.0:1787432572.438077:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432572.440060:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588365056 00000100:00100000:3.0:1787432572.440077:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588365056 00000100:00100000:3.0:1787432572.440238:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 371 00000100:00100000:3.0:1787432572.440252:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948406122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:6175:x1874258588365056:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432572.440439:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948406122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:6175:x1874258588365056:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 190us (2373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432572.440448:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 371 00000100:00100000:3.0:1787432572.447665:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432572.448136:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588365184 00000100:00100000:2.0:1787432572.448149:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588365184 00000100:00100000:2.0:1787432572.448501:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 372 00000100:00100000:2.0:1787432572.448514:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:6175:x1874258588365184:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432572.448690:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:6175:x1874258588365184:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 Request processed in 178us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432572.448698:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 372 00000100:00100000:1.0:1787432572.453706:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432572.453782:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588365312 00000100:00100000:0.0:1787432572.453794:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588365312 00000100:00100000:0.0:1787432572.453899:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 373 00000100:00100000:0.0:1787432572.453912:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:10825:x1874258588365312:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787432572.454087:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:10825:x1874258588365312:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 177us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432572.454107:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 373 00000100:00100000:1.0:1787432572.466311:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432572.466474:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588365440 00000100:00100000:3.0:1787432572.466484:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588365440 00000100:00100000:3.0:1787432572.466537:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 374 00000100:00100000:3.0:1787432572.466549:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:10825:x1874258588365440:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787432572.466694:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:10825:x1874258588365440:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 148us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432572.466703:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 374 00000100:00100000:0.0:1787432572.875888:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432572.877536:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609425792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432572.877623:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432572.877949:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609425792 00000100:00100000:1.0:1787432572.877961:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609425792 00000100:00100000:1.0:1787432572.878021:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787432572.878032:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609425792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787432572.878068:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787432572.878142:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609425792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432572.878149:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787432572.878359:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609425792:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787432573.134978:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787432573.388564:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787432573.390089:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787432573.465232:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432573.465279:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432573.465298:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432573.465327:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432573.465365:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432573.465385:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432573.465415:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588365696 00000100:00100000:2.0:1787432573.465425:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588365696 00000100:00100000:2.0:1787432573.465477:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588366208 00000100:00100000:2.0:1787432573.465479:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588366208 00000100:00100000:2.0:1787432573.465490:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588365824 00000100:00100000:2.0:1787432573.465492:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588365824 00000100:00100000:2.0:1787432573.465503:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588366080 00000100:00100000:2.0:1787432573.465505:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588366080 00000100:00100000:2.0:1787432573.465518:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 249 00000100:00100000:2.0:1787432573.465528:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588365696:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432573.465597:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588365696:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 70us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432573.465604:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 249 00000100:00100000:2.0:1787432573.465620:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 250 00000100:00100000:2.0:1787432573.465627:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588366208:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432573.465651:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588366208:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432573.465657:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 250 00000100:00100000:2.0:1787432573.465668:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 251 00000100:00100000:2.0:1787432573.465674:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588365824:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432573.465693:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588365824:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 20us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432573.465698:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 251 00000100:00100000:2.0:1787432573.465709:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 252 00000100:00100000:2.0:1787432573.465722:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588366080:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432573.465744:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588366080:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432573.465750:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 252 00000100:00100000:2.0:1787432573.465769:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588365568 00000100:00100000:2.0:1787432573.465773:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588365568 00000100:00100000:2.0:1787432573.465798:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 375 00000100:00100000:2.0:1787432573.465805:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:2402:x1874258588365568:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432573.465829:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:2402:x1874258588365568:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432573.465835:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 375 00000100:00080000:3.0:1787432573.465933:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432573.465938:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432573.466003:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588365952 00000100:00100000:0.0:1787432573.466007:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588365952 00000100:00100000:0.0:1787432573.466060:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 70 00000100:00100000:0.0:1787432573.466069:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588365952:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432573.466117:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588365952:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 49us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432573.466123:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 70 00000100:00080000:3.0:1787432573.466204:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787432574.156707:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432575.180530:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432575.947392:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432575.947415:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609425920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432575.947526:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432575.947870:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609425920 00000100:00100000:0.0:1787432575.947878:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609425920 00000100:00100000:0.0:1787432575.947931:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787432575.947941:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609425920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432575.947991:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787432575.948051:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609425920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432575.948058:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787432575.948236:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432575.948248:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609426048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432575.948286:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432575.948394:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609425920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432575.948457:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609426048 00000100:00100000:0.0:1787432575.948461:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609426048 00000100:00100000:0.0:1787432575.948508:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787432575.948516:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609426048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432575.948537:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432575.948573:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609426048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432575.948579:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1787432575.948671:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787432575.948696:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303a38a80 x1874258609426048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432575.948710:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609426048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432575.949417:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432575.949431:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609426176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432575.949483:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432575.949678:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609426176 00000100:00100000:0.0:1787432575.949684:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609426176 00000100:00100000:0.0:1787432575.949752:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787432575.949761:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609426176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787432575.949776:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432575.949817:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609426176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432575.949833:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000001:00080000:3.0:1787432575.951809:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00080000:2.0:1787432575.951975:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787432575.952041:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303a38700 x1874258609426176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432575.952082:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609426176:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787432576.203537:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432576.459892:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432576.459916:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f91ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609426304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432576.459990:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432576.460219:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609426304 00000100:00100000:1.0:1787432576.460227:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609426304 00000100:00100000:1.0:1787432576.460289:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787432576.460300:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609426304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787432576.460329:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432576.460408:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609426304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432576.460415:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787432576.460611:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f91ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609426304:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787432576.460685:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432576.461109:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609426688:0@lo:400:kworker.0 00000100:00100000:3.0:1787432576.461179:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432576.461204:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609427200:0@lo:400:kworker.0 00000100:00100000:3.0:1787432576.461227:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432576.461251:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787432576.461256:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609426816:0@lo:400:kworker.0 00000100:00100000:3.0:1787432576.461279:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432576.461294:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609427328:0@lo:400:kworker.0 00000100:00100000:3.0:1787432576.461313:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432576.461334:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609426688 00000100:00100000:3.0:1787432576.461339:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609426688 00000100:00100000:3.0:1787432576.461371:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609427200 00000100:00100000:3.0:1787432576.461374:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609427200 00000100:00100000:3.0:1787432576.461393:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609427328 00000100:00100000:0.0:1787432576.461706:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787432576.461716:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f92a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609426688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432576.461776:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f92a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609426688:12345-0@lo:400:kworker.0 Request processed in 62us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432576.461783:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787432576.461798:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787432576.461804:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609427200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432576.461826:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609427200:12345-0@lo:400:kworker.0 Request processed in 23us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432576.461831:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787432576.461863:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609426688:0@lo:400:kworker.0 00000100:00100000:0.0:1787432576.461872:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609427200:0@lo:400:kworker.0 00000100:00100000:3.0:1787432576.462065:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609427328 00000100:00100000:3.0:1787432576.462104:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787432576.462112:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609427328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432576.462344:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609427328:12345-0@lo:400:kworker.0 Request processed in 233us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432576.462351:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787432576.462448:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609426816 00000100:00100000:2.0:1787432576.462453:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609426816 00000100:00100000:2.0:1787432576.462492:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787432576.462499:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609426816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432576.462536:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609426816:12345-0@lo:400:kworker.0 Request processed in 38us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432576.462542:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1787432576.462558:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787432576.462562:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432576.462574:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609426432:0@lo:400:kworker.0 00000100:00100000:2.0:1787432576.462606:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432576.462630:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609426944:0@lo:400:kworker.0 00000100:00100000:2.0:1787432576.462673:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432576.462693:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609427456:0@lo:400:kworker.0 00000100:00100000:2.0:1787432576.462715:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432576.463032:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787432576.463041:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609426560:0@lo:400:kworker.0 00000100:00100000:2.0:1787432576.463068:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432576.463083:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609427072:0@lo:400:kworker.0 00000100:00100000:2.0:1787432576.463104:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432576.463126:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609426944 00000100:00100000:2.0:1787432576.463130:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609426944 00000100:00100000:2.0:1787432576.463157:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609426560 00000100:00100000:2.0:1787432576.463196:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609426560 00000100:00100000:2.0:1787432576.463213:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609427072 00000100:00100000:2.0:1787432576.463215:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609427072 00000100:00100000:2.0:1787432576.463231:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787432576.463236:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609426944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432576.463272:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609426944:12345-0@lo:400:kworker.0 Request processed in 35us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432576.463278:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787432576.463290:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787432576.463296:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609426560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432576.463325:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609426560:12345-0@lo:400:kworker.0 Request processed in 29us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432576.463331:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787432576.463341:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787432576.463348:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609427072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432576.463371:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609427072:12345-0@lo:400:kworker.0 Request processed in 24us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432576.463376:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:2.0:1787432576.463389:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787432576.463392:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432576.463893:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609426816:0@lo:400:kworker.0 00010000:00080000:0.0:1787432576.463910:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830379ad80 x1874258609427328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432576.463922:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609427328:0@lo:400:kworker.0 00000100:00100000:3.0:1787432576.464035:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609426432 00000100:00100000:3.0:1787432576.464041:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609426432 00000100:00100000:3.0:1787432576.464077:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1787432576.464086:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3641:x1874258609426432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432576.464137:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3641:x1874258609426432:12345-0@lo:400:kworker.0 Request processed in 53us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432576.464144:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1787432576.464193:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609427456 00000100:00100000:3.0:1787432576.464197:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609427456 00000100:00100000:3.0:1787432576.464232:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787432576.464240:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609427456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432576.464271:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609427456:12345-0@lo:400:kworker.0 Request processed in 33us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432576.464277:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1787432576.464295:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432576.464418:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609427584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432576.464454:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432576.464494:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609427584 00000100:00100000:1.0:1787432576.464498:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609427584 00000100:00100000:1.0:1787432576.464521:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787432576.464528:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609427584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787432576.464543:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432576.464576:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609427584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432576.464582:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787432576.464610:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1787432576.464615:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff948303b38000, transno 4294967301 00000100:00100000:1.0:1787432576.464630:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609427584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432576.468995:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609426560:0@lo:400:kworker.0 00010000:00080000:0.0:1787432576.469043:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303798380 x1874258609427072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432576.469056:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609427072:0@lo:400:kworker.0 00000100:00100000:0.0:1787432576.469069:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609426432:0@lo:400:kworker.0 00000100:00100000:0.0:1787432576.469082:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609426944:0@lo:400:kworker.0 00000100:00100000:0.0:1787432576.469095:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609427456:0@lo:400:kworker.0 00010000:00010000:2.0:1787432577.227365:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432577.995552:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432577.995578:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609427712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432577.995669:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432577.995814:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609427712 00000100:00100000:1.0:1787432577.995823:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609427712 00000100:00100000:1.0:1787432577.995876:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787432577.995886:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609427712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787432577.995923:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787432577.996004:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609427712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432577.996012:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787432577.996152:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609427712:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787432578.251463:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432578.587855:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432578.587913:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432578.588023:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432578.588056:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432578.588080:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432578.588103:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432578.588130:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588366720 00000100:00100000:0.0:1787432578.588140:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588366720 00000100:00100000:0.0:1787432578.588243:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 72 00000100:00100000:0.0:1787432578.588253:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588366720:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432578.588335:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588366720:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 83us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432578.588343:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 72 00000100:00100000:0.0:1787432578.588497:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588366464 00000100:00100000:0.0:1787432578.588502:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588366464 00000100:00100000:0.0:1787432578.588527:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588366592 00000100:00100000:0.0:1787432578.588530:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588366592 00000100:00100000:0.0:1787432578.588543:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588366848 00000100:00100000:0.0:1787432578.588545:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588366848 00000100:00100000:0.0:1787432578.588576:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588366976 00000100:00100000:0.0:1787432578.588579:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588366976 00000100:00100000:0.0:1787432578.588592:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 259 00000100:00100000:0.0:1787432578.588599:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588366464:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432578.588627:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588366464:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432578.588634:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 259 00000100:00100000:0.0:1787432578.588645:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 260 00000100:00100000:0.0:1787432578.588651:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588366592:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432578.588844:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 261 00000100:00100000:3.0:1787432578.588854:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588366848:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432578.588881:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588366848:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432578.588888:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 261 00000100:00100000:3.0:1787432578.588900:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 262 00000100:00100000:3.0:1787432578.588906:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588366976:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432578.588926:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588366976:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 20us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432578.588941:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 262 00000100:00080000:3.0:1787432578.588960:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432578.588964:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432578.588967:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432578.590381:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588366592:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 22us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432578.590394:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 260 00000100:00100000:1.0:1787432578.592374:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588366336 00000100:00100000:1.0:1787432578.592391:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588366336 00000100:00100000:1.0:1787432578.595195:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 377 00000100:00100000:1.0:1787432578.597108:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948407db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:2401:x1874258588366336:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432578.597423:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948407db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:2401:x1874258588366336:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 331us (9506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432578.597430:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 377 00010000:00010000:1.0:1787432579.275551:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432580.300223:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432581.067398:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787432581.067419:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609427840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432581.067499:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432581.067563:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609427968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432581.067591:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432581.068850:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609427840 00000100:00100000:0.0:1787432581.068859:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609427840 00000100:00100000:1.0:1787432581.068910:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432581.068916:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787432581.068924:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609428096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432581.068937:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609427840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432581.068967:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432581.068981:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432581.069018:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609427840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432581.069025:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787432581.069036:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609428096 00000100:00100000:1.0:1787432581.069039:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609428096 00000100:00100000:1.0:1787432581.069069:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787432581.069077:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609428096:12345-0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1787432581.069077:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303bc2300 x1874258609427840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00000024:1.0:1787432581.069087:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432581.069096:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609427840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432581.069129:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609428096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432581.069135:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:2.0:1787432581.069209:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303a3b480 x1874258609428096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432581.069226:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609428096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432581.069722:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609427968 00000100:00100000:1.0:1787432581.069729:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609427968 00000100:00080000:3.0:1787432581.069730:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432581.069774:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787432581.069782:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609427968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787432581.069805:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787432581.069870:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609427968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (2278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432581.069877:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787432581.070588:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609427968:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787432581.325395:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432581.579362:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432581.579385:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609428224:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432581.579455:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432581.579959:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609428224 00000100:00100000:1.0:1787432581.579969:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609428224 00000100:00100000:1.0:1787432581.580044:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787432581.580055:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609428224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787432581.580082:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432581.580135:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609428224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432581.580155:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787432581.580213:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432581.580229:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609428352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432581.580269:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432581.580303:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609428608:0@lo:400:kworker.0 00000100:00100000:2.0:1787432581.580337:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432581.580344:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609428736:0@lo:400:kworker.0 00000100:00100000:2.0:1787432581.580364:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609429120:0@lo:400:kworker.0 00000100:00100000:1.0:1787432581.580384:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432581.580412:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609428352 00000100:00100000:2.0:1787432581.580417:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609428352 00000100:00100000:1.0:1787432581.580417:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609429248:0@lo:400:kworker.0 00000100:00100000:1.0:1787432581.580450:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432581.580461:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787432581.580471:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609428352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432581.580484:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432581.580516:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609428352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432581.580521:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787432581.580540:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432581.580588:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609428352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432581.580613:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609428608 00000100:00100000:1.0:1787432581.580619:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609428608 00000100:00100000:1.0:1787432581.580660:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609428736 00000100:00100000:1.0:1787432581.580664:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609428736 00000100:00100000:1.0:1787432581.580676:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609429248 00000100:00100000:1.0:1787432581.580678:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609429248 00000100:00100000:1.0:1787432581.580691:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609429120 00000100:00100000:1.0:1787432581.580693:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609429120 00000100:00100000:1.0:1787432581.580707:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787432581.580714:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609428608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432581.580750:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609428608:12345-0@lo:400:kworker.0 Request processed in 36us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432581.580756:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787432581.580784:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787432581.580790:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609428736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432581.580822:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787432581.580829:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609428736:12345-0@lo:400:kworker.0 Request processed in 38us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432581.580834:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609429248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432581.580841:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787432581.580859:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787432581.580868:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609429120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432581.580877:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609429248:12345-0@lo:400:kworker.0 Request processed in 47us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432581.580885:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787432581.580910:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609429120:12345-0@lo:400:kworker.0 Request processed in 44us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432581.580928:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00010000:00080000:2.0:1787432581.580931:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f919500 x1874258609429120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432581.580943:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609429120:0@lo:400:kworker.0 00000100:00080000:3.0:1787432581.581011:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432581.581016:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432581.581018:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432581.581044:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609428480:0@lo:400:kworker.0 00000100:00100000:1.0:1787432581.581080:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609428736:0@lo:400:kworker.0 00000100:00100000:0.0:1787432581.581159:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609428864:0@lo:400:kworker.0 00000100:00100000:2.0:1787432581.582730:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609428608:0@lo:400:kworker.0 00000100:00100000:3.0:1787432581.583390:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432581.583450:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609428992:0@lo:400:kworker.0 00000100:00100000:3.0:1787432581.583484:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432581.583526:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609428224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432581.587073:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609428480 00000100:00100000:2.0:1787432581.587089:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609428480 00000100:00100000:2.0:1787432581.587204:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1787432581.587216:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405079c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3644:x1874258609428480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432581.587316:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405079c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3644:x1874258609428480:12345-0@lo:400:kworker.0 Request processed in 103us (3929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432581.587323:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1787432581.587360:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609428992 00000100:00100000:2.0:1787432581.587364:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609428992 00000100:00100000:2.0:1787432581.587407:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787432581.587415:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609428992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432581.587449:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609428992:12345-0@lo:400:kworker.0 Request processed in 35us (3963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432581.587455:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1787432581.587629:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432581.587664:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609428480:0@lo:400:kworker.0 00000100:00100000:3.0:1787432581.587680:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609428992:0@lo:400:kworker.0 00000100:00100000:1.0:1787432581.588074:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609429248:0@lo:400:kworker.0 00000100:00100000:0.0:1787432581.589076:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432581.589273:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609429376:0@lo:400:kworker.0 00000100:00100000:0.0:1787432581.589306:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432581.592137:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609429376 00000100:00100000:3.0:1787432581.592245:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609429376 00000100:00100000:3.0:1787432581.592427:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787432581.592439:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609429376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432581.592537:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609429376:12345-0@lo:400:kworker.0 Request processed in 100us (3229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432581.592559:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787432581.593483:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609428864 00000100:00100000:2.0:1787432581.593492:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609428864 00000100:00100000:2.0:1787432581.593533:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787432581.593541:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609428864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432581.593612:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609428864:12345-0@lo:400:kworker.0 Request processed in 72us (4539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432581.593619:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787432581.593678:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609428864:0@lo:400:kworker.0 00010000:00080000:2.0:1787432581.593692:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f91a680 x1874258609429376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432581.593703:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609429376:0@lo:400:kworker.0 00000100:00080000:0.0:1787432581.596277:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787432582.349840:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432583.115731:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432583.115795:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609429504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432583.115865:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432583.116005:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609429504 00000100:00100000:1.0:1787432583.116013:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609429504 00000100:00100000:1.0:1787432583.116061:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787432583.116071:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609429504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787432583.116102:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787432583.116158:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609429504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432583.116190:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787432583.116338:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609429504:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787432583.371512:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787432583.627916:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787432583.629818:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787432583.705066:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432583.705110:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432583.705146:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432583.705273:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432583.705293:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432583.705350:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588367488 00000100:00100000:1.0:1787432583.705360:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588367488 00000100:00100000:1.0:1787432583.705429:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 73 00000100:00100000:1.0:1787432583.705440:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588367488:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432583.705548:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588367488:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 110us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432583.705556:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 73 00000100:00100000:1.0:1787432583.705581:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588367104 00000100:00100000:1.0:1787432583.705585:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588367104 00000100:00100000:1.0:1787432583.705611:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 379 00000100:00100000:1.0:1787432583.705619:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840507ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:2402:x1874258588367104:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432583.705645:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840507ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:2402:x1874258588367104:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432583.705652:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 379 00000100:00080000:1.0:1787432583.705700:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432583.711141:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432583.711249:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588367232 00000100:00100000:2.0:1787432583.711258:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588367232 00000100:00100000:2.0:1787432583.711327:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588367744 00000100:00100000:2.0:1787432583.711330:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588367744 00000100:00100000:2.0:1787432583.711348:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588367360 00000100:00100000:2.0:1787432583.711351:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588367360 00000100:00100000:2.0:1787432583.711372:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 269 00000100:00100000:2.0:1787432583.711382:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588367232:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432583.711711:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588367232:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 330us (6656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432583.711719:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 269 00000100:00100000:2.0:1787432583.711736:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 270 00000100:00100000:2.0:1787432583.711743:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588367744:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432583.711767:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588367744:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (6620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432583.711773:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 270 00000100:00100000:2.0:1787432583.711784:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 271 00000100:00100000:2.0:1787432583.711797:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588367360:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432583.711819:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588367360:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (6526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432583.711825:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 271 00000100:00080000:2.0:1787432583.712032:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787432583.712037:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432583.714250:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588367616 00000100:00100000:1.0:1787432583.714263:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588367616 00000100:00100000:1.0:1787432583.714350:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 272 00000100:00100000:1.0:1787432583.714362:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588367616:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432583.714850:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588367616:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 94us (3325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432583.714861:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 272 00000100:00080000:2.0:1787432583.714946:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787432584.396781:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432585.419392:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432586.187768:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609429632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432586.187855:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432586.187929:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432586.187935:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609429760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787432586.187959:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432586.188619:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609429632 00000100:00100000:1.0:1787432586.188622:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609429888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432586.188628:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609429632 00000100:00100000:1.0:1787432586.188672:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432586.188703:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609429760 00000100:00100000:2.0:1787432586.188708:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609429760 00000100:00100000:1.0:1787432586.188721:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609429888 00000100:00100000:1.0:1787432586.188726:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609429888 00000100:00100000:2.0:1787432586.188736:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787432586.188749:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609429632:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432586.188762:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787432586.188772:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609429888:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:2.0:1787432586.188780:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432586.188844:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609429632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (989us total) trans 0 rc 0/0 00000004:00000024:1.0:1787432586.188847:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787432586.188854:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787432586.188874:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787432586.188883:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609429760:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432586.188894:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609429888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (220us total) trans 0 rc 0/0 00002000:00000024:2.0:1787432586.188895:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432586.188906:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787432586.188935:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609429760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432586.188942:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787432586.188956:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609429888:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1787432586.189000:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830379ad80 x1874258609429760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432586.189015:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609429760:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1787432586.189027:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303bc3b80 x1874258609429632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432586.189038:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609429632:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787432586.189106:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787432586.444956:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432586.699474:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609430272:0@lo:400:kworker.0 00000100:00100000:1.0:1787432586.699551:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432586.699595:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609430400:0@lo:400:kworker.0 00000100:00100000:1.0:1787432586.699609:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609430784:0@lo:400:kworker.0 00000100:00100000:0.0:1787432586.699640:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432586.699646:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432586.699678:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787432586.699684:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609430144:0@lo:400:kworker.0 00000100:00100000:1.0:1787432586.699707:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432586.699723:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609430656:0@lo:400:kworker.0 00000100:00100000:0.0:1787432586.699740:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609430912:0@lo:400:kworker.0 00000100:00100000:0.0:1787432586.699765:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432586.699786:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787432586.699792:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609430016:0@lo:400:kworker.0 00000100:00100000:0.0:1787432586.699831:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432586.699853:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609430528:0@lo:400:kworker.0 00000100:00100000:0.0:1787432586.699875:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432586.699889:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609431040:0@lo:400:kworker.0 00000100:00100000:0.0:1787432586.699909:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432586.699951:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609431040 00000100:00100000:0.0:1787432586.699959:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609431040 00000100:00100000:0.0:1787432586.700012:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787432586.700021:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609431040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432586.700071:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609431040:12345-0@lo:400:kworker.0 Request processed in 52us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432586.700078:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1787432586.700099:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432586.700126:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609431040:0@lo:400:kworker.0 00000100:00100000:0.0:1787432586.700157:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609430272 00000100:00100000:0.0:1787432586.700161:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609430272 00000100:00100000:0.0:1787432586.700206:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609430784 00000100:00100000:0.0:1787432586.700209:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609430784 00000100:00100000:0.0:1787432586.700227:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609430144 00000100:00100000:0.0:1787432586.700230:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609430144 00000100:00100000:0.0:1787432586.700240:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609430912 00000100:00100000:0.0:1787432586.700242:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609430912 00000100:00100000:0.0:1787432586.700253:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609430528 00000100:00100000:0.0:1787432586.700255:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609430528 00000100:00100000:0.0:1787432586.700274:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787432586.700282:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609430272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432586.700315:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609430272:12345-0@lo:400:kworker.0 Request processed in 34us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432586.700322:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787432586.700333:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787432586.700339:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609430784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432586.700365:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609430784:12345-0@lo:400:kworker.0 Request processed in 27us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432586.700380:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787432586.700392:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787432586.700397:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609430144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432586.700425:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609430144:12345-0@lo:400:kworker.0 Request processed in 28us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432586.700431:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787432586.700443:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787432586.700450:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609430912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432586.700479:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609430912:12345-0@lo:400:kworker.0 Request processed in 30us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432586.700485:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787432586.700495:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787432586.700501:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609430528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432586.700672:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609430016 00000100:00100000:3.0:1787432586.700678:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609430016 00000100:00100000:3.0:1787432586.700709:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1787432586.700716:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609430016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432586.700748:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609430016:12345-0@lo:400:kworker.0 Request processed in 33us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432586.700754:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00080000:3.0:1787432586.700856:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432586.700860:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432586.700879:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609430016:0@lo:400:kworker.0 00010000:00080000:3.0:1787432586.700894:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405560e00 x1874258609430912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432586.700904:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609430912:0@lo:400:kworker.0 00000100:00100000:1.0:1787432586.700995:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432586.701026:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609431168:0@lo:400:kworker.0 00000100:00100000:3.0:1787432586.701037:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609430656 00000100:00100000:3.0:1787432586.701043:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609430656 00000100:00100000:1.0:1787432586.701055:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432586.701086:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787432586.701089:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609430272:0@lo:400:kworker.0 00000100:00100000:3.0:1787432586.701097:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609430656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432586.701106:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609430784:0@lo:400:kworker.0 00000100:00100000:1.0:1787432586.701127:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609431296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432586.701136:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609430656:12345-0@lo:400:kworker.0 Request processed in 41us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432586.701155:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:3.0:1787432586.701194:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787432586.701214:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609431168 00000100:00100000:3.0:1787432586.701217:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609431168 00000100:00100000:3.0:1787432586.701246:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787432586.701252:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609431168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432586.701282:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609431168:12345-0@lo:400:kworker.0 Request processed in 30us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432586.701288:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787432586.701301:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432586.701413:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609430400 00000100:00100000:2.0:1787432586.701418:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609430400 00000100:00100000:2.0:1787432586.701456:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787432586.701463:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609430400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432586.701503:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609430400:12345-0@lo:400:kworker.0 Request processed in 41us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432586.701522:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787432586.701565:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609430400:0@lo:400:kworker.0 00000100:00100000:3.0:1787432586.701783:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432586.701792:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609431424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432586.701999:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432586.702052:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609430144:0@lo:400:kworker.0 00010000:00080000:1.0:1787432586.702066:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405560380 x1874258609430656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432586.702090:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609430656:0@lo:400:kworker.0 00000100:00100000:1.0:1787432586.702102:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609431168:0@lo:400:kworker.0 00000100:00100000:1.0:1787432586.702131:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432586.702236:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609431296 00000100:00100000:3.0:1787432586.702241:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609431296 00000100:00100000:3.0:1787432586.702268:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609431424 00000100:00100000:3.0:1787432586.702270:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609431424 00000100:00100000:3.0:1787432586.702282:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787432586.702288:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609431296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787432586.702308:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432586.702347:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609431296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432586.702353:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787432586.702364:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787432586.702369:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609431424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787432586.702377:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432586.702398:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609431424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432586.702411:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787432586.702972:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609431424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432586.703008:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609431296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432586.704387:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609430528:12345-0@lo:400:kworker.0 Request processed in 3880us (4505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432586.704398:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787432586.706046:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609430528:0@lo:400:kworker.0 00010000:00010000:2.0:1787432587.468850:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432588.240994:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432588.241020:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609431552:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787432588.241084:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432588.241738:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609431552 00000100:00100000:1.0:1787432588.241746:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609431552 00000100:00100000:1.0:1787432588.241800:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787432588.241809:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609431552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787432588.241901:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787432588.241966:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609431552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 158us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432588.241974:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787432588.242098:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609431552:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787432588.496601:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432588.826673:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432588.826725:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432588.826764:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432588.826869:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588368000 00000100:00100000:0.0:1787432588.826880:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588368000 00000100:00100000:1.0:1787432588.826889:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588367872 00000100:00100000:1.0:1787432588.826896:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588367872 00000100:00100000:0.0:1787432588.826945:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588368128 00000100:00100000:0.0:1787432588.826949:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588368128 00000100:00100000:1.0:1787432588.826964:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 381 00000100:00100000:0.0:1787432588.826973:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 279 00000100:00100000:1.0:1787432588.826978:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840507a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588367872:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432588.826995:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588368000:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432588.827057:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840507a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588367872:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 83us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432588.827070:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 381 00000100:00080000:2.0:1787432588.827088:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787432588.827094:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432588.827199:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 280 00000100:00100000:3.0:1787432588.827212:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588368128:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432588.831703:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588368128:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 4480us (4924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432588.831720:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 280 00000100:00100000:0.0:1787432588.831951:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588368000:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 4956us (5286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432588.831961:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 279 00000100:00100000:0.0:1787432588.842247:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432588.842358:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432588.842397:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432588.842478:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588368512 00000100:00100000:3.0:1787432588.842488:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588368512 00000100:00100000:3.0:1787432588.842555:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588368384 00000100:00100000:3.0:1787432588.842559:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588368384 00000100:00100000:3.0:1787432588.842586:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 281 00000100:00100000:3.0:1787432588.842598:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588368512:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432588.842687:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588368512:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 92us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432588.842695:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 281 00000100:00100000:3.0:1787432588.842713:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 282 00000100:00100000:3.0:1787432588.842721:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588368384:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432588.842749:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588368384:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432588.842755:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 282 00000100:00080000:0.0:1787432588.843647:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787432588.843654:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787432588.844502:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588368256 00000100:00100000:2.0:1787432588.844513:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588368256 00000100:00100000:2.0:1787432588.844651:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 27 00000100:00100000:2.0:1787432588.844678:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405563100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2399:x1874258588368256:12345-192.168.204.24@tcp:9:kworker.0 00000020:00000080:2.0:1787432588.844705:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ed87 00000100:00080000:2.0:1787432588.844714:0:8431:0:(import.c:65:import_set_state_nolock()) ffff94843f83d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787432588.844818:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1787432588.844971:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405563100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+2:2399:x1874258588368256:12345-192.168.204.24@tcp:9:kworker.0 Request processed in 310us (2734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432588.844991:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 27 00010000:00010000:1.0:1787432588.845908:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787432588.846250:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787432589.515521:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432590.539820:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432591.308320:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432591.308344:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609431680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432591.308455:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432591.308658:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609431680 00000100:00100000:0.0:1787432591.308667:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609431680 00000100:00100000:0.0:1787432591.308740:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787432591.308750:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609431680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432591.308784:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787432591.308834:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609431680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432591.308841:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787432591.309045:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609431680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432591.309599:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432591.309612:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609431936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432591.309663:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432591.309688:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432591.309709:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609431808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432591.309748:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432591.309792:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609431936 00000100:00100000:1.0:1787432591.309797:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609431936 00000100:00100000:1.0:1787432591.309869:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609431808 00000100:00100000:1.0:1787432591.309873:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609431808 00000100:00100000:3.0:1787432591.309878:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787432591.309888:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609431936:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432591.309890:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787432591.309895:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609431808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432591.309910:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1787432591.309910:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432591.309948:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609431936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432591.309948:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609431808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432591.309955:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1787432591.309973:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787432591.309996:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484359eaa00 x1874258609431808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432591.310011:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609431808:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787432591.310055:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405563480 x1874258609431936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432591.310067:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609431936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787432591.314827:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00010000:1.0:1787432591.564771:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432591.819385:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609432064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432591.819461:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432591.819664:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609432192:0@lo:400:kworker.0 00000100:00100000:1.0:1787432591.819731:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432591.819759:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609432320:0@lo:400:kworker.0 00000100:00100000:1.0:1787432591.819769:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609432704:0@lo:400:kworker.0 00000100:00100000:2.0:1787432591.819803:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432591.819834:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432591.819838:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609432832:0@lo:400:kworker.0 00000100:00100000:1.0:1787432591.819857:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609433216:0@lo:400:kworker.0 00000100:00100000:2.0:1787432591.819871:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432591.819906:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432591.819911:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405565c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609432576:0@lo:400:kworker.0 00000100:00100000:2.0:1787432591.819946:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432591.819949:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609432448:0@lo:400:kworker.0 00000100:00100000:2.0:1787432591.819989:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609433088:0@lo:400:kworker.0 00000100:00100000:1.0:1787432591.819991:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432591.820014:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609432960:0@lo:400:kworker.0 00000100:00100000:2.0:1787432591.820025:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432591.820046:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432591.820069:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609432576 00000100:00100000:2.0:1787432591.820078:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609432576 00000100:00100000:1.0:1787432591.820086:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609432320 00000100:00100000:1.0:1787432591.820091:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609432320 00000100:00100000:1.0:1787432591.820121:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609432704 00000100:00100000:1.0:1787432591.820124:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609432704 00000100:00100000:2.0:1787432591.820134:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1787432591.820144:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432591.820146:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609432576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432591.820161:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609432832 00000100:00100000:1.0:1787432591.820184:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609432832 00000100:00080000:1.0:1787432591.820196:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432591.820208:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609432448 00000100:00100000:1.0:1787432591.820210:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609432448 00000100:00100000:1.0:1787432591.820220:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609433088 00000100:00100000:1.0:1787432591.820222:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609433088 00000100:00080000:1.0:1787432591.820232:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432591.820242:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609432960 00000100:00100000:1.0:1787432591.820244:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609432960 00000100:00080000:1.0:1787432591.820252:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432591.820266:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787432591.820272:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609432320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432591.820326:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609432320:12345-0@lo:400:kworker.0 Request processed in 52us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432591.820334:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787432591.820352:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787432591.820364:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609432576:12345-0@lo:400:kworker.0 Request processed in 220us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432591.820370:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609432704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432591.820377:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787432591.820403:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787432591.820414:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609432832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432591.820419:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609432704:12345-0@lo:400:kworker.0 Request processed in 51us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432591.820428:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787432591.820466:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609432704:0@lo:400:kworker.0 00000100:00100000:2.0:1787432591.820472:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609432832:12345-0@lo:400:kworker.0 Request processed in 60us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432591.820480:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787432591.820500:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787432591.820509:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609432448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432591.820547:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609432448:12345-0@lo:400:kworker.0 Request processed in 40us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432591.820614:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609432192 00000100:00100000:3.0:1787432591.820619:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609432192 00000100:00100000:3.0:1787432591.820648:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1787432591.820656:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94840507a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3641:x1874258609432192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432591.820692:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94840507a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3641:x1874258609432192:12345-0@lo:400:kworker.0 Request processed in 38us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432591.820698:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1787432591.820740:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609433216 00000100:00100000:3.0:1787432591.820744:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609433216 00000100:00100000:3.0:1787432591.820776:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787432591.820783:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609433216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432591.820815:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609433216:12345-0@lo:400:kworker.0 Request processed in 33us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432591.820821:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787432591.820865:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787432591.820873:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609433088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432591.820902:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609433088:12345-0@lo:400:kworker.0 Request processed in 31us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432591.820918:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787432591.820931:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787432591.820938:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609432960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432591.820966:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609432960:12345-0@lo:400:kworker.0 Request processed in 29us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432591.820986:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787432591.821009:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609433344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432591.821039:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432591.821806:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787432591.821852:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609432448:0@lo:400:kworker.0 00000100:00100000:1.0:1787432591.821863:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609432960:0@lo:400:kworker.0 00000100:00100000:1.0:1787432591.821938:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609433216:0@lo:400:kworker.0 00000100:00100000:1.0:1787432591.821947:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609432192:0@lo:400:kworker.0 00000100:00100000:1.0:1787432591.821983:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405565c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609432576:0@lo:400:kworker.0 00010000:00080000:1.0:1787432591.821996:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405567b80 x1874258609433088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432591.822007:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609433088:0@lo:400:kworker.0 00000100:00080000:1.0:1787432591.822121:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432591.825065:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609432320:0@lo:400:kworker.0 00010000:00080000:2.0:1787432591.825087:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405565880 x1874258609432832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432591.825431:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609432832:0@lo:400:kworker.0 00000100:00100000:0.0:1787432591.826622:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609432064 00000100:00100000:0.0:1787432591.826639:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609432064 00000100:00100000:0.0:1787432591.826751:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609433344 00000100:00100000:0.0:1787432591.826755:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609433344 00000100:00100000:0.0:1787432591.826776:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1787432591.826778:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432591.826789:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609432064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787432591.826821:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432591.826919:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609432064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (7457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432591.826998:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609432064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432591.827309:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787432591.827326:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609433344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787432591.827340:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432591.827436:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609433344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (6395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432591.829445:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609433344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432591.830022:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787432591.830418:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00010000:0.0:1787432592.590210:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432593.357291:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432593.357317:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609433472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432593.357518:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432593.357665:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609433472 00000100:00100000:2.0:1787432593.357674:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609433472 00000100:00100000:2.0:1787432593.357738:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787432593.357749:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609433472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787432593.357784:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787432593.357842:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609433472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432593.357849:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787432593.358938:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609433472:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787432593.613242:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787432593.871556:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787432593.872575:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787432593.941883:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432593.941942:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432593.941976:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432593.942007:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432593.942033:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432593.942063:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588368896 00000100:00100000:0.0:1787432593.942073:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588368896 00000100:00100000:0.0:1787432593.942131:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588369152 00000100:00100000:0.0:1787432593.942135:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588369152 00000100:00100000:0.0:1787432593.942153:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588368768 00000100:00100000:0.0:1787432593.942156:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588368768 00000100:00100000:0.0:1787432593.942200:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588369024 00000100:00100000:0.0:1787432593.942205:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588369024 00000100:00100000:0.0:1787432593.942224:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 289 00000100:00100000:0.0:1787432593.942235:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588368896:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432593.942317:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588368896:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 83us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432593.942326:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 289 00000100:00100000:0.0:1787432593.942347:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 290 00000100:00100000:0.0:1787432593.942355:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588369152:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432593.942397:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588369152:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 42us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432593.942404:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 290 00000100:00100000:0.0:1787432593.942433:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 291 00000100:00100000:0.0:1787432593.942440:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588368768:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432593.942471:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588368768:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 32us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432593.942477:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 291 00000100:00100000:0.0:1787432593.942492:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 292 00000100:00100000:0.0:1787432593.942499:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588369024:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432593.942524:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588369024:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432593.942530:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 292 00000100:00080000:0.0:1787432593.942553:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787432593.942557:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787432593.943051:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588368640 00000100:00100000:3.0:1787432593.943058:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588368640 00000100:00100000:3.0:1787432593.943102:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 383 00000100:00100000:3.0:1787432593.943111:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588368640:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432593.943151:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588368640:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 41us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432593.943158:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 383 00010000:00010000:1.0:1787432594.637223:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787432594.894205:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000020:00000080:3.0:1787432594.894217:0:9509:0:(genops.c:885:class_export_put()) final put ffff94843f838000/e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000020:00000080:0.0:1787432594.894396:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff94843f838000/e37f63ac-9665-4d30-ad26-0faad6e6c7da for lustre-OST0001 00000020:00000080:0.0:1787432594.894453:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94843f83d000 for lustre-OST0001 00010000:00010000:0.0:1787432595.668925:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432596.439142:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609433600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432596.439291:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432596.439382:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609433600 00000100:00100000:1.0:1787432596.439391:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609433600 00000100:00100000:1.0:1787432596.439440:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787432596.439450:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609433600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787432596.439488:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787432596.439560:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609433600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432596.439568:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787432596.439636:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609433600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432596.439759:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432596.439783:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609433728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432596.439830:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432596.439877:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609433728 00000100:00100000:2.0:1787432596.439882:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609433728 00000100:00100000:2.0:1787432596.439932:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787432596.439941:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609433728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432596.439960:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432596.439995:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609433728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432596.440002:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1787432596.440020:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787432596.440039:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405565500 x1874258609433728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432596.440053:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609433728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432596.450136:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432596.450182:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609433856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432596.450274:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432596.450778:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609433856 00000100:00100000:0.0:1787432596.450786:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609433856 00000100:00100000:0.0:1787432596.450847:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787432596.450856:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609433856:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787432596.451071:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787432596.451146:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432596.451317:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609433856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 460us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432596.451335:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:1.0:1787432596.464222:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484359eb480 x1874258609433856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432596.464253:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609433856:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787432596.684612:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432596.946789:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609433984:0@lo:400:kworker.0 00000100:00100000:2.0:1787432596.946869:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432596.946915:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609434496:0@lo:400:kworker.0 00000100:00100000:2.0:1787432596.946967:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432596.946990:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609435008:0@lo:400:kworker.0 00000100:00100000:2.0:1787432596.947015:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432596.947034:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609435520:0@lo:400:kworker.0 00000100:00100000:2.0:1787432596.947055:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432596.947080:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787432596.947325:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609434240:0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.947355:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432596.947376:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609434752:0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.947401:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432596.947420:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609435264:0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.947441:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432596.947460:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787432596.947475:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609434368:0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.947502:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432596.947521:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405565c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609434880:0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.947544:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432596.947562:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609435392:0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.947582:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432596.947632:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609434496 00000100:00100000:1.0:1787432596.947640:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609434496 00000100:00100000:1.0:1787432596.947682:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609434240 00000100:00100000:1.0:1787432596.947686:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609434240 00000100:00100000:1.0:1787432596.947702:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787432596.947710:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609434496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.947932:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609434496:12345-0@lo:400:kworker.0 Request processed in 221us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432596.947940:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787432596.947960:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787432596.947967:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609434240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.948003:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609434240:12345-0@lo:400:kworker.0 Request processed in 36us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432596.948009:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787432596.948030:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609434752 00000100:00100000:1.0:1787432596.948033:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609434752 00000100:00100000:1.0:1787432596.948066:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609435264 00000100:00100000:1.0:1787432596.948069:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609435264 00000100:00100000:1.0:1787432596.948086:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609434368 00000100:00100000:1.0:1787432596.948089:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609434368 00000100:00100000:1.0:1787432596.948102:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787432596.948108:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609434752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.948148:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609434752:12345-0@lo:400:kworker.0 Request processed in 39us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432596.948154:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787432596.948196:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787432596.948203:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609435264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.948231:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609435264:12345-0@lo:400:kworker.0 Request processed in 28us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432596.948236:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787432596.948249:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787432596.948255:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609434368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.948283:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609434368:12345-0@lo:400:kworker.0 Request processed in 29us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432596.948289:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787432596.948316:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609435008 00000100:00100000:1.0:1787432596.948321:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609435008 00000100:00100000:1.0:1787432596.948339:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609435520 00000100:00100000:1.0:1787432596.948342:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609435520 00000100:00100000:1.0:1787432596.948355:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609434880 00000100:00100000:1.0:1787432596.948358:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609434880 00000100:00100000:1.0:1787432596.948368:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609435392 00000100:00100000:1.0:1787432596.948370:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609435392 00000100:00100000:1.0:1787432596.948386:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787432596.948392:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609435008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.948423:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609435008:12345-0@lo:400:kworker.0 Request processed in 31us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432596.948429:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787432596.948440:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787432596.948452:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609435520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.948480:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609435520:12345-0@lo:400:kworker.0 Request processed in 29us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432596.948486:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787432596.948496:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787432596.948502:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609434880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.948527:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609434880:12345-0@lo:400:kworker.0 Request processed in 26us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432596.948533:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787432596.948543:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787432596.948549:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609435392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.948571:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609435392:12345-0@lo:400:kworker.0 Request processed in 23us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432596.948577:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1787432596.948600:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432596.948606:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432596.948659:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609434368:0@lo:400:kworker.0 00010000:00080000:1.0:1787432596.948672:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405565c00 x1874258609434880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432596.948681:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405565c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609434880:0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.948689:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609435392:0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.948698:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609434240:0@lo:400:kworker.0 00010000:00080000:1.0:1787432596.948706:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405567b80 x1874258609434752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432596.948725:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609434752:0@lo:400:kworker.0 00010000:00080000:1.0:1787432596.948735:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405566d80 x1874258609435264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432596.948743:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609435264:0@lo:400:kworker.0 00000100:00100000:0.0:1787432596.948874:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432596.948886:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609435776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432596.948920:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432596.948961:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609435776 00000100:00100000:0.0:1787432596.948965:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609435776 00000100:00100000:0.0:1787432596.948992:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787432596.949000:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609435776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787432596.949020:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432596.949056:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609435776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432596.949061:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787432596.949093:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609435776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432596.949249:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609434112:0@lo:400:kworker.0 00000100:00100000:2.0:1787432596.949288:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432596.950344:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609434624:0@lo:400:kworker.0 00000100:00100000:2.0:1787432596.950382:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432596.955149:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609433984 00000100:00100000:1.0:1787432596.955196:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609433984 00000100:00100000:1.0:1787432596.955256:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1787432596.955267:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609433984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.955356:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609433984:12345-0@lo:400:kworker.0 Request processed in 90us (8487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432596.955363:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1787432596.955406:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609435648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787432596.955441:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432596.956311:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609435648 00000100:00100000:1.0:1787432596.956320:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609435648 00000100:00100000:1.0:1787432596.956364:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787432596.956372:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609435648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787432596.956391:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432596.956442:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609435648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432596.956449:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787432596.956491:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609435648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432596.959560:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609435136:0@lo:400:kworker.0 00000100:00100000:2.0:1787432596.959638:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432596.959720:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609434112 00000100:00100000:0.0:1787432596.959740:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609434112 00000100:00100000:1.0:1787432596.962993:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609434624 00000100:00100000:1.0:1787432596.963027:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609434624 00000100:00100000:1.0:1787432596.963097:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787432596.963112:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609434112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.963224:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609434112:12345-0@lo:400:kworker.0 Request processed in 115us (13934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432596.963232:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787432596.963248:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787432596.963255:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609434624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.963283:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609434624:12345-0@lo:400:kworker.0 Request processed in 30us (12901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432596.963289:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:3.0:1787432596.963359:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432596.965286:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609435136 00000100:00100000:1.0:1787432596.965298:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609435136 00000100:00100000:1.0:1787432596.965362:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787432596.965372:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609435136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432596.965447:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609435136:12345-0@lo:400:kworker.0 Request processed in 77us (5809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432596.965455:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:3.0:1787432596.965512:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432596.966559:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609435136:0@lo:400:kworker.0 00000100:00100000:3.0:1787432596.966574:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609433984:0@lo:400:kworker.0 00000100:00100000:3.0:1787432596.966583:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609434496:0@lo:400:kworker.0 00010000:00080000:3.0:1787432596.966599:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405564e00 x1874258609435008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432596.966608:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609435008:0@lo:400:kworker.0 00000100:00100000:3.0:1787432596.966631:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609435520:0@lo:400:kworker.0 00000100:00100000:3.0:1787432596.966670:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609434112:0@lo:400:kworker.0 00000100:00100000:3.0:1787432596.966682:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609434624:0@lo:400:kworker.0 00010000:00010000:1.0:1787432597.707611:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432598.477487:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609435904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432598.477571:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432598.478557:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609435904 00000100:00100000:2.0:1787432598.478567:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609435904 00000100:00100000:2.0:1787432598.478630:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787432598.478641:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609435904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787432598.478674:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787432598.478737:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609435904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432598.478745:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787432598.479000:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609435904:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1787432598.671525:0:14073:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 17:03:16 (1787432596) 00010000:00010000:0.0:1787432598.732141:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432599.065754:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432599.065791:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432599.065835:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432599.065864:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432599.065948:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432599.065981:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588369408 00000100:00100000:0.0:1787432599.065990:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588369408 00000100:00100000:0.0:1787432599.066040:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588369664 00000100:00100000:0.0:1787432599.066042:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588369664 00000100:00100000:0.0:1787432599.066054:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588369536 00000100:00100000:0.0:1787432599.066056:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588369536 00000100:00100000:0.0:1787432599.066067:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588369792 00000100:00100000:0.0:1787432599.066069:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588369792 00000100:00100000:2.0:1787432599.066209:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 299 00000100:00100000:2.0:1787432599.066239:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588369408:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432599.066331:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588369408:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 96us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432599.066340:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 299 00000100:00100000:2.0:1787432599.066360:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 300 00000100:00100000:2.0:1787432599.066367:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588369664:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432599.066393:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588369664:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432599.066399:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 300 00000100:00100000:2.0:1787432599.066414:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 301 00000100:00100000:2.0:1787432599.066427:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588369536:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432599.066452:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588369536:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432599.066459:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 301 00000100:00100000:2.0:1787432599.066470:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 302 00000100:00100000:2.0:1787432599.066476:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588369792:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432599.066497:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588369792:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 21us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432599.066502:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 302 00000100:00100000:3.0:1787432599.066822:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588369280 00000100:00100000:3.0:1787432599.066828:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588369280 00000100:00100000:3.0:1787432599.066872:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 385 00000100:00100000:3.0:1787432599.066880:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588369280:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432599.066912:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588369280:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 34us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432599.066918:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 385 00000100:00080000:3.0:1787432599.066945:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432599.066949:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787432599.755571:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432600.530721:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432600.530839:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588369920 00000100:00100000:1.0:1787432600.530850:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588369920 00000100:00100000:1.0:1787432600.530919:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 40 00000100:00100000:1.0:1787432600.530929:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:11115:x1874258588369920:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432600.530949:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432600.531051:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563ee67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d4c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.531159:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563ee6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.531220:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563ee6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.531237:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563ee6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432600.531302:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787432600.531306:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432600.531349:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563ee6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.531374:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563ee67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d4c expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.531392:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563ee6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d4c expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.531400:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94841318b000) 00010000:00010000:1.0:1787432600.531402:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432600.531405:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851c00, rc 0) 00000100:00100000:1.0:1787432600.531483:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:11115:x1874258588369920:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 554us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432600.531491:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 40 00000100:00100000:3.0:1787432600.560798:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432600.563597:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588370048 00000100:00100000:1.0:1787432600.563617:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588370048 00000100:00100000:1.0:1787432600.563737:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 41 00000100:00100000:1.0:1787432600.563750:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:11116:x1874258588370048:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432600.563776:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432600.563798:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563ee75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d53 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.563865:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.563879:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.563891:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.563905:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.563913:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.563920:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564000:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850200/0xca72b3b33563ee8a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564008:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850200/0xca72b3b33563ee8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564016:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850200/0xca72b3b33563ee8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432600.564075:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787432600.564620:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432600.564656:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303850200/0xca72b3b33563ee8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564671:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564678:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564685:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564692:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432600.564698:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564705:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564721:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94841318b000) 00010000:00010000:1.0:1787432600.564724:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432600.564729:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564736:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564751:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564770:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564776:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564781:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850800 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432600.564785:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564792:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564800:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff94841318bc00) 00010000:00010000:1.0:1787432600.564803:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432600.564806:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564812:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564848:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563ee75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d53 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564862:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850200/0xca72b3b33563ee8a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d53 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.564870:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94841318b900) 00010000:00010000:1.0:1787432600.564872:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432600.564881:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850200, rc 0) 00000100:00100000:1.0:1787432600.568273:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:11116:x1874258588370048:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 4511us (7472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432600.568288:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 41 00000100:00100000:0.0:1787432600.581945:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432600.582039:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588370176 00000100:00100000:1.0:1787432600.582051:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588370176 00000100:00100000:1.0:1787432600.582124:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:1.0:1787432600.582136:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:11116:x1874258588370176:12345-192.168.204.24@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787432600.582504:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:11116:x1874258588370176:12345-192.168.204.24@tcp:900:lhsmtool_posix.0 Request processed in 369us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432600.582514:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:0.0:1787432600.593216:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432600.593411:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588370432 00000100:00100000:1.0:1787432600.593423:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588370432 00000100:00100000:1.0:1787432600.593500:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 42 00000100:00100000:1.0:1787432600.593512:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:11116:x1874258588370432:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432600.593535:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432600.593565:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563ee91 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d5a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.593642:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee98 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.593658:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee98 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.593669:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee98 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.593751:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee9f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.593774:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee9f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.593782:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee9f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.593901:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850600/0xca72b3b33563eea6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.593910:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850600/0xca72b3b33563eea6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.593917:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850600/0xca72b3b33563eea6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432600.593928:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787432600.594027:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee98 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.594035:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee98 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.594042:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee98 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.594048:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850800 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432600.594053:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee98 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.594061:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee98 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.594100:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94841318b900) 00010000:00010000:1.0:1787432600.594104:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432600.594111:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee98 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.594118:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563ee98 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.594133:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee9f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.594139:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee9f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.594146:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee9f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.594151:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432600.594153:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee9f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.594159:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee9f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.594226:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff94841318bc00) 00010000:00010000:1.0:1787432600.594228:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432600.594232:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee9f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.594237:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ee9f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.600811:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563ee91 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d5a expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.600841:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850600/0xca72b3b33563eea6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d5a expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432600.600852:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94841318b400) 00010000:00010000:1.0:1787432600.600855:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432600.600859:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850600, rc 0) 00000100:00100000:1.0:1787432600.600930:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:11116:x1874258588370432:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 7419us (7768us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787432600.600939:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 42 00000100:00100000:3.0:1787432600.606269:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432600.606461:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588370560 00000100:00100000:0.0:1787432600.606473:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588370560 00000100:00100000:0.0:1787432600.606532:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 43 00000100:00100000:0.0:1787432600.606553:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:11116:x1874258588370560:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787432600.606693:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:11116:x1874258588370560:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 151us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432600.606700:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 43 00000100:00100000:0.0:1787432600.620736:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432600.620909:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588370688 00000100:00100000:2.0:1787432600.620919:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588370688 00000100:00100000:2.0:1787432600.620991:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 44 00000100:00100000:2.0:1787432600.621004:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:11116:x1874258588370688:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1787432600.627417:0:9020:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6362us 00000100:00100000:2.0:1787432600.663261:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:11116:x1874258588370688:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 42249us (42527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432600.663276:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 44 00010000:00010000:1.0:1787432600.779656:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787432601.038108:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787432601.039479:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787432601.547443:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609436032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432601.550739:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432601.550823:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432601.550838:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609436160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432601.551571:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432601.551584:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609436288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432601.551629:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432601.551670:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609436288 00000100:00100000:0.0:1787432601.551677:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609436288 00000100:00100000:0.0:1787432601.551730:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787432601.551740:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609436288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432601.551780:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787432601.551834:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609436288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432601.551842:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787432601.551890:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609436288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432601.554120:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432601.554291:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609436032 00000100:00100000:2.0:1787432601.554300:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609436032 00000100:00100000:2.0:1787432601.554360:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609436160 00000100:00100000:2.0:1787432601.554363:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609436160 00000100:00100000:2.0:1787432601.554383:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787432601.554393:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609436032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432601.554425:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432601.554480:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609436032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (3749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432601.554488:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787432601.554506:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787432601.554513:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609436160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787432601.554522:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787432601.554559:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609436160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432601.554565:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1787432601.554586:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787432601.555103:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948409d25880 x1874258609436160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432601.555131:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609436160:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1787432601.555148:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948408b49880 x1874258609436032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432601.555439:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609436032:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787432601.806244:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432602.059411:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432602.059436:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609436416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432602.059551:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432602.059632:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609436416 00000100:00100000:0.0:1787432602.059641:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609436416 00000100:00100000:0.0:1787432602.059702:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787432602.059714:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609436416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787432602.059747:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432602.059791:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609436416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432602.059798:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1787432602.059819:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432602.059854:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609436416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432602.060252:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609436544:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.060290:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432602.060315:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405501880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609437056:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.060338:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432602.060353:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609437568:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.060373:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432602.060391:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787432602.060396:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609436672:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.060419:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432602.060435:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609437184:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.060455:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432602.060472:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609437696:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.060491:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432602.060528:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609436928:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.060552:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432602.060569:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609437440:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.060589:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432602.060602:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609437952:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.060635:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432602.060657:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787432602.060662:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609436800:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.060682:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432602.060699:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609437312:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.060729:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432602.060745:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609437824:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.060762:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432602.060781:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609436544 00000100:00100000:1.0:1787432602.060785:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609436544 00000100:00100000:1.0:1787432602.060817:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1787432602.060825:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609436544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.060861:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609436544:12345-0@lo:400:kworker.0 Request processed in 37us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432602.060868:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1787432602.060895:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609437056 00000100:00100000:1.0:1787432602.060899:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609437056 00000100:00100000:1.0:1787432602.060921:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609436800 00000100:00100000:1.0:1787432602.060923:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609436800 00000100:00100000:1.0:1787432602.060936:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787432602.060942:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609437056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.060971:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609437056:12345-0@lo:400:kworker.0 Request processed in 30us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432602.060978:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787432602.060989:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787432602.060995:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609436800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.061024:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609436800:12345-0@lo:400:kworker.0 Request processed in 29us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432602.061029:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787432602.061046:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609437568 00000100:00100000:1.0:1787432602.061049:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609437568 00000100:00100000:1.0:1787432602.061071:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609437440 00000100:00100000:1.0:1787432602.061079:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609437440 00000100:00100000:1.0:1787432602.061093:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609437952 00000100:00100000:1.0:1787432602.061095:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609437952 00000100:00100000:1.0:1787432602.061118:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787432602.061124:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609437568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.061153:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609437568:12345-0@lo:400:kworker.0 Request processed in 30us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432602.061159:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787432602.061197:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787432602.061203:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609437440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.061230:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609437440:12345-0@lo:400:kworker.0 Request processed in 28us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432602.061236:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787432602.061246:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787432602.061251:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609437952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.061275:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609437952:12345-0@lo:400:kworker.0 Request processed in 24us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432602.061281:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787432602.061301:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609436672 00000100:00100000:1.0:1787432602.061304:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609436672 00000100:00100000:1.0:1787432602.061323:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609437184 00000100:00100000:1.0:1787432602.061326:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609437184 00000100:00100000:1.0:1787432602.061338:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609437696 00000100:00100000:1.0:1787432602.061340:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609437696 00000100:00100000:1.0:1787432602.061349:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609436928 00000100:00100000:1.0:1787432602.061350:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609436928 00000100:00100000:1.0:1787432602.061359:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609437312 00000100:00100000:1.0:1787432602.061361:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609437312 00000100:00100000:1.0:1787432602.061371:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609437824 00000100:00100000:1.0:1787432602.061379:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609437824 00000100:00100000:1.0:1787432602.061399:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1787432602.061405:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609436672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.061436:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609436672:12345-0@lo:400:kworker.0 Request processed in 31us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432602.061441:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1787432602.061453:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787432602.061458:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609437184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.061483:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609437184:12345-0@lo:400:kworker.0 Request processed in 25us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432602.061488:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787432602.061500:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787432602.061506:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609437696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.061546:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609437696:12345-0@lo:400:kworker.0 Request processed in 40us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432602.061551:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787432602.061562:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787432602.061568:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609436928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.061591:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609436928:12345-0@lo:400:kworker.0 Request processed in 24us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432602.061597:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787432602.061606:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787432602.061612:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609437312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.061630:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609437312:12345-0@lo:400:kworker.0 Request processed in 19us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432602.061644:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787432602.061654:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787432602.061659:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609437824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.061681:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609437824:12345-0@lo:400:kworker.0 Request processed in 22us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432602.061686:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:1.0:1787432602.061730:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432602.061734:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432602.061736:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432602.061758:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609436800:0@lo:400:kworker.0 00010000:00080000:1.0:1787432602.061776:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405566680 x1874258609437312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432602.061787:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609437312:0@lo:400:kworker.0 00010000:00080000:1.0:1787432602.061795:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405564380 x1874258609437824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432602.061803:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609437824:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.061812:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609436928:0@lo:400:kworker.0 00010000:00080000:1.0:1787432602.061820:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405564e00 x1874258609437440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432602.061828:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609437440:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.061836:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609437952:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.061868:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609436672:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.061885:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609437184:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.061892:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609437696:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.061900:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609436544:0@lo:400:kworker.0 00000100:00100000:1.0:1787432602.061907:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405501880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609437056:0@lo:400:kworker.0 00010000:00080000:1.0:1787432602.061916:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405564000 x1874258609437568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432602.061924:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609437568:0@lo:400:kworker.0 00000100:00100000:2.0:1787432602.062390:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432602.062402:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609438080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432602.062438:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432602.062507:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609438080 00000100:00100000:3.0:1787432602.062511:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609438080 00000100:00100000:3.0:1787432602.062561:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787432602.062568:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609438080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787432602.062581:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432602.062620:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609438080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432602.062626:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787432602.062688:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609438080:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787432602.828384:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432602.904120:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432602.906489:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588370816 00000100:00100000:0.0:1787432602.906515:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588370816 00000100:00100000:0.0:1787432602.906587:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 45 00000100:00100000:0.0:1787432602.906598:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:11158:x1874258588370816:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787432602.906618:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432602.906651:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563eeb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d61 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906716:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563eebb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906731:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563eebb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906743:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563eebb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906783:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563eec2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906791:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563eec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906799:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563eec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906841:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563eebb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906848:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563eebb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906855:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563eebb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906861:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94840149f200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432602.906865:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563eebb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906872:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563eebb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906884:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94841318b000) 00010000:00010000:0.0:1787432602.906887:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432602.906892:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563eebb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906898:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563eebb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906916:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563eec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906922:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563eec2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906928:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563eec2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906933:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94840149ec00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432602.906935:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563eec2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906941:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563eec2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906948:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff948411a7a200) 00010000:00010000:0.0:1787432602.906951:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432602.906953:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563eec2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906958:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563eec2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906987:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563eeb4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d61 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.906997:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94841318b000) 00010000:00010000:0.0:1787432602.907000:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432602.907010:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563eeb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d61 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432602.907020:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94840149f000, rc 0) 00000100:00080000:1.0:1787432602.908013:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432602.908363:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:11158:x1874258588370816:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1759us (4247us total) trans 0 rc 301/301 00000100:00100000:0.0:1787432602.908373:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 45 00000100:00100000:1.0:1787432602.922741:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432602.922917:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588371072 00000100:00100000:3.0:1787432602.922930:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588371072 00000100:00100000:3.0:1787432602.923001:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 46 00000100:00100000:3.0:1787432602.923012:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:11158:x1874258588371072:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:3.0:1787432602.923078:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432602.923111:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563ee6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d4c expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.923139:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94841318b000) 00010000:00010000:3.0:1787432602.923152:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432602.923248:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563eec9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.923262:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563eec9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.923272:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563eec9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.923285:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563eed0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.923292:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563eed0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.923299:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563eed0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.924088:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563eed7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.924101:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563eed7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.924109:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563eed7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432602.924125:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf80ad20 reply state 000000003f959511 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563eed7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.924149:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563eed7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.924156:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:3.0:1787432602.924159:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787432602.924185:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787432602.924191:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787432602.924199:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563eec9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.924206:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563eec9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.924212:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563eec9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.924219:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432602.924223:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563eec9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.924230:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563eec9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.924240:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435957a00) 00010000:00010000:3.0:1787432602.924242:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432602.924245:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563eec9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.924251:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563eec9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432602.924277:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf80ad20 reply state 000000003f959511 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563eed0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.924286:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563eed0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432602.924292:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff948435957400) 00010000:00010000:3.0:1787432602.924294:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787432602.924296:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787432602.924400:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+10:11158:x1874258588371072:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 1387us (1673us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787432602.924409:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 46 00000100:00100000:0.0:1787432603.063911:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432603.064351:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588371200 00000100:00100000:2.0:1787432603.064362:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588371200 00000100:00100000:2.0:1787432603.064430:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 47 00000100:00100000:2.0:1787432603.064442:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+10:11166:x1874258588371200:12345-192.168.204.24@tcp:101:lctl.0 00010000:00010000:2.0:1787432603.064478:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432603.064520:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563eede lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d68 expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.064619:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563eee5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.064636:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563eee5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.064666:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563eee5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432603.064718:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787432603.064722:0:9020:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787432603.064760:0:9020:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563eee5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.064786:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563eede lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d68 expref: 12 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.064812:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563eee5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d68 expref: 11 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.064821:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766b00) 00010000:00010000:2.0:1787432603.064824:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432603.064829:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e200, rc 0) 00000100:00100000:2.0:1787432603.064893:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+11:11166:x1874258588371200:12345-192.168.204.24@tcp:101:lctl.0 Request processed in 453us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432603.064900:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 47 00000040:00080000:3.0:1787432603.085039:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787432603.086151:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787432603.159043:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432603.161842:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588371328 00000100:00100000:0.0:1787432603.161858:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588371328 00000100:00100000:0.0:1787432603.161933:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 48 00000100:00100000:0.0:1787432603.161944:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+11:11172:x1874258588371328:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787432603.161966:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432603.161990:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563eeec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d6f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162063:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eef3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162078:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eef3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162091:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eef3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162103:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563eefa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162109:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563eefa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162144:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563eefa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162287:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030200/0xca72b3b33563ef01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162295:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030200/0xca72b3b33563ef01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162302:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030200/0xca72b3b33563ef01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432603.162337:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787432603.162341:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787432603.162379:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948400030200/0xca72b3b33563ef01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162391:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eef3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162398:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eef3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162404:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eef3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162410:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432603.162414:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eef3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162421:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eef3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162439:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766b00) 00010000:00010000:0.0:1787432603.162442:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432603.162447:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eef3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162453:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563eef3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162467:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563eefa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162473:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563eefa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162478:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563eefa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162483:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432603.162486:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563eefa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162504:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563eefa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162513:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff948435957400) 00010000:00010000:0.0:1787432603.162515:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432603.162518:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563eefa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162524:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563eefa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162560:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563eeec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d6f expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162574:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030200/0xca72b3b33563ef01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d6f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.162582:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:0.0:1787432603.162584:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787432603.162587:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948400030200, rc 0) 00000100:00100000:0.0:1787432603.162655:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+12:11172:x1874258588371328:12345-192.168.204.24@tcp:101:bash.0 Request processed in 712us (3622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432603.162664:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 48 00000100:00100000:0.0:1787432603.170506:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432603.170595:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588371584 00000100:00100000:1.0:1787432603.170606:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588371584 00000100:00100000:1.0:1787432603.170672:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 49 00000100:00100000:1.0:1787432603.170684:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+12:11172:x1874258588371584:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787432603.170707:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432603.170728:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563ef08 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d76 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.170851:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563ef0f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.170867:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563ef0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.170879:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563ef0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.170955:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563ef16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.170964:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563ef16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.170972:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563ef16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787432603.172446:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787432603.172626:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ef1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.172640:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ef1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.172649:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ef1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.172678:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563ef0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.172684:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563ef0f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.172691:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563ef0f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.172696:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432603.172701:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563ef0f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.172724:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563ef0f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.172736:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:1.0:1787432603.172740:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432603.172746:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563ef0f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.172751:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563ef0f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787432603.172764:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e67c6fcb reply state 0000000002200505 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563ef16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.172774:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563ef16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.172779:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9483032ad300) 00010000:00010000:1.0:1787432603.172781:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787432603.172784:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787432603.172821:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563ef08 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d76 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.172835:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ef1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d76 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.172843:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032ada00) 00010000:00010000:1.0:1787432603.172844:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432603.172847:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851a00, rc 0) 00000100:00100000:1.0:1787432603.172922:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:11172:x1874258588371584:12345-192.168.204.24@tcp:101:bash.0 Request processed in 2240us (2444us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787432603.172936:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 49 00000100:00100000:1.0:1787432603.180573:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432603.183263:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588371712 00000100:00100000:2.0:1787432603.183277:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588371712 00000100:00100000:2.0:1787432603.183331:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 28 00000100:00100000:2.0:1787432603.183341:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1874258588371712:12345-192.168.204.24@tcp:8:bash.0 00010000:00080000:2.0:1787432603.183375:0:8430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:2.0:1787432603.183410:0:8430:0:(genops.c:1385:class_connect()) connect: client e37f63ac-9665-4d30-ad26-0faad6e6c7da, cookie 0xca72b3b33563ef2b 00002000:00100000:2.0:1787432603.183422:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e37f63ac-9665-4d30-ad26-0faad6e6c7da/ffff948416482000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787432603.183455:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787432603.183545:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787432603.183578:0:8430:0:(import.c:65:import_set_state_nolock()) ffff948416487000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432603.183658:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2399:x1874258588371712:12345-192.168.204.24@tcp:8:bash.0 Request processed in 316us (3094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432603.183666:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 28 00000100:00100000:3.0:1787432603.193059:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432603.193150:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588371840 00000100:00100000:1.0:1787432603.193161:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588371840 00000100:00100000:1.0:1787432603.193266:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 29 00000100:00100000:1.0:1787432603.193277:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843cb9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:0:x1874258588371840:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787432603.193300:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432603.193324:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef32 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d7d expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787432603.193352:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432603.193372:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=414s v=(0 0) 00010000:00010000:1.0:1787432603.193377:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432603.193387:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d7d expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.193411:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d7d expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.193425:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851400, rc 0) 00000100:00080000:3.0:1787432603.193550:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432603.193588:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843cb9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:0:x1874258588371840:12345-192.168.204.24@tcp:101:bash.0 Request processed in 311us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432603.193595:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 29 00000100:00100000:2.0:1787432603.208313:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432603.208386:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588371968 00000100:00100000:1.0:1787432603.208398:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588371968 00000100:00100000:1.0:1787432603.208471:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 30 00000100:00100000:1.0:1787432603.208483:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:11172:x1874258588371968:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787432603.208516:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432603.208548:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019e53fe6/0xca72b3b33563ef39 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d84 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.208593:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef32 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d7d expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.208602:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432603.208607:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432603.208612:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019e53fe6/0xca72b3b33563ef39 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d84 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.208649:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d7d expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.208663:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef32 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d7d expref: 8 pid: 8431 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432603.208677:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304436680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874258609438208:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432603.210208:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483030150c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432603.215464:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432603.215571:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588372096 00000100:00100000:3.0:1787432603.215582:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588372096 00010000:00010000:3.0:1787432603.215627:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef32 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d7d expref: 9 pid: 8431 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432603.215669:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00100000:3.0:1787432603.215679:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94841223c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2403:x1874258588372096:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432603.215693:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432603.215714:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef32 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d7d expref: 9 pid: 8431 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432603.215760:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef32 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d7d expref: 9 pid: 8431 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432603.215788:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432603.215792:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432603.215800:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019e53fe6/0xca72b3b33563ef39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d84 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432603.215811:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019e53fe6/0xca72b3b33563ef39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d84 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432603.215846:0:7465:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000019e53fe6/0xca72b3b33563ef39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d84 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432603.215861:0:7465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7465:1874258609438336:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787432603.215948:0:7465:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932fa80 going to sleep for 11 seconds 00010000:00010000:1.0:1787432603.216575:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef32 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d7d expref: 9 pid: 8431 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432603.216595:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304436680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874258609438208:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432603.216624:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000019e53fe6/0xca72b3b33563ef39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d84 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.216650:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850400, rc 0) 00000100:00100000:1.0:1787432603.216699:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:11172:x1874258588371968:12345-192.168.204.24@tcp:101:bash.0 Request processed in 8218us (8399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432603.216707:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 30 00000100:00100000:2.0:1787432603.221835:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432603.221990:0:7465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7465:1874258609438336:192.168.204.24@tcp:105: 00010000:00010000:3.0:1787432603.222017:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432603.222097:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94841223c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2403:x1874258588372096:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 6417us (6642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432603.222110:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00100000:0.0:1787432603.222448:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588372352 00000100:00100000:0.0:1787432603.222456:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588372352 00000100:00100000:0.0:1787432603.222513:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 6 00000100:00100000:0.0:1787432603.222524:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:11172:x1874258588372352:12345-192.168.204.24@tcp:35:bash.0 00000100:00100000:0.0:1787432603.222832:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:11172:x1874258588372352:12345-192.168.204.24@tcp:35:bash.0 Request processed in 310us (1006us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787432603.222839:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 6 00000100:00100000:2.0:1787432603.327219:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432603.327359:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588372608 00000100:00100000:3.0:1787432603.327368:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588372608 00000100:00100000:3.0:1787432603.327422:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 50 00000100:00100000:3.0:1787432603.327432:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:11182:x1874258588372608:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432603.327469:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432603.327488:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ef40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d8b expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432603.327597:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787432603.327700:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ef40 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d8b expref: 18 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432603.327714:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766b00) 00010000:00010000:3.0:1787432603.327718:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432603.327723:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ef40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d8b expref: 18 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432603.327754:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303013e00, rc 0) 00000100:00100000:3.0:1787432603.327819:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+17:11182:x1874258588372608:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 388us (658us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1787432603.327827:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 50 00000100:00100000:1.0:1787432603.337388:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432603.337500:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588372864 00000100:00100000:0.0:1787432603.337511:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588372864 00000100:00100000:0.0:1787432603.337568:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:0.0:1787432603.337580:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+17:11182:x1874258588372864:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:0.0:1787432603.337822:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:11182:x1874258588372864:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 243us (444us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787432603.337847:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:2.0:1787432603.426462:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432603.426626:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588372992 00000100:00100000:3.0:1787432603.426636:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588372992 00000100:00100000:3.0:1787432603.426703:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 51 00000100:00100000:3.0:1787432603.426713:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:11188:x1874258588372992:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432603.426746:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432603.426767:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ef4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d92 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432603.426832:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ef55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432603.426865:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ef55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432603.426876:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ef55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432603.426920:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787432603.426924:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787432603.426955:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ef55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432603.426983:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ef4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d92 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432603.427001:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ef55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d92 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432603.427011:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:3.0:1787432603.427014:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432603.427017:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303013600, rc 0) 00000100:00100000:3.0:1787432603.427094:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:11188:x1874258588372992:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 382us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432603.427101:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 51 00000100:00100000:2.0:1787432603.435917:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432603.436836:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588373248 00000100:00100000:1.0:1787432603.436848:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588373248 00000100:00100000:1.0:1787432603.436916:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00100000:1.0:1787432603.436928:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:11188:x1874258588373248:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787432603.436959:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432603.436980:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563ef5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4d99 expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.437104:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563ef63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.437119:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563ef63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.437131:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563ef63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432603.437144:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787432603.437317:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563ef5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d99 expref: 22 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.437336:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563ef63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d99 expref: 21 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.437435:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032ada00) 00010000:00010000:1.0:1787432603.437438:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432603.437442:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851000, rc 0) 00000100:00100000:1.0:1787432603.437521:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:11188:x1874258588373248:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 594us (1613us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787432603.437528:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00100000:0.0:1787432603.442037:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432603.442183:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588373504 00000100:00100000:1.0:1787432603.442204:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588373504 00000100:00100000:1.0:1787432603.442268:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 53 00000100:00100000:1.0:1787432603.442279:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:11188:x1874258588373504:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787432603.442305:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432603.442326:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ef71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4da0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.442617:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563ef78 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.442634:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563ef78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.442645:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563ef78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432603.442657:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787432603.442764:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563ef71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4da0 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.442807:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563ef78 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4da0 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.442817:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032ada00) 00010000:00010000:1.0:1787432603.442820:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787432603.442824:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851c00, rc 0) 00000100:00100000:1.0:1787432603.442887:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:11188:x1874258588373504:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 609us (872us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787432603.442895:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 53 00000100:00100000:2.0:1787432603.451124:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432603.451218:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432603.451520:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588373632 00000100:00100000:3.0:1787432603.451529:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588373632 00000100:00100000:3.0:1787432603.451601:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:3.0:1787432603.451612:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:2402:x1874258588373632:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432603.451628:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432603.451667:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563ef63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d99 expref: 23 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432603.451688:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032ada00) 00010000:00010000:3.0:1787432603.451694:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432603.451763:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:2402:x1874258588373632:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 153us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432603.451771:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:1.0:1787432603.452971:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588373760 00000100:00100000:1.0:1787432603.452983:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588373760 00000100:00100000:1.0:1787432603.453053:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 31 00000100:00100000:1.0:1787432603.453063:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2403:x1874258588373760:12345-192.168.204.24@tcp:1:lfs.0 00010000:00010000:1.0:1787432603.453106:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef86 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.453127:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000019e53fe6/0xca72b3b33563ef39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d84 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.453136:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432603.453141:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787432603.453146:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef86 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.453221:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000019e53fe6/0xca72b3b33563ef39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d84 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.453248:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000019e53fe6/0xca72b3b33563ef39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d84 expref: 7 pid: 8430 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432603.453265:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304436a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1874258609438464:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432603.453612:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303015f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432603.458616:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304436a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1874258609438464:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432603.458649:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef86 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432603.460006:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432603.460103:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588373888 00000100:00100000:3.0:1787432603.460112:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588373888 00002000:00100000:3.0:1787432603.460212:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff948409d25f80 x1874258588373888/t0(0) o4->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:314/0 lens 504/0 e 0 to 0 dl 1787432614 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787432603.460224:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948409d25f80 with x1874258588373888 ext(0->12) 00010000:00010000:3.0:1787432603.460233:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000019e53fe6/0xca72b3b33563ef39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d84 expref: 8 pid: 8430 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432603.460249:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000019e53fe6/0xca72b3b33563ef39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d84 expref: 8 pid: 8430 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432603.460257:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff948409d25f80 00000100:00100000:3.0:1787432603.460281:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:3.0:1787432603.460292:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2402:x1874258588373888:12345-192.168.204.24@tcp:4:lfs.0 00000001:00100000:1.0:1787432603.465736:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000100:00100000:3.0:1787432603.468105:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2402:x1874258588373888:12345-192.168.204.24@tcp:4:lfs.0 Request processed in 7802us (8095us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787432603.468122:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 0 00002000:00100000:3.0:1787432603.468135:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff948409d25f80 x1874258588373888/t4294967300(0) o4->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:314/0 lens 504/448 e 0 to 0 dl 1787432614 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787432603.468789:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948409d25f80 with x1874258588373888 ext(0->12) 00010000:00010000:3.0:1787432603.468804:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000019e53fe6/0xca72b3b33563ef39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d84 expref: 9 pid: 8430 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432603.468827:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000019e53fe6/0xca72b3b33563ef39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d84 expref: 9 pid: 8430 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432603.468836:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff948409d25f80 00000100:00100000:2.0:1787432603.472611:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432603.472740:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588374016 00000100:00100000:0.0:1787432603.472751:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588374016 00010000:00010000:0.0:1787432603.472794:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000019e53fe6/0xca72b3b33563ef39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d84 expref: 9 pid: 8430 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432603.472842:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 53 00000100:00100000:0.0:1787432603.472853:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2403:x1874258588374016:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432603.472867:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787432603.472886:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787432603.472889:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787432602 00002000:00010000:0.0:1787432603.472891:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787432603 00002000:00010000:0.0:1787432603.472893:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787432602 00002000:00010000:0.0:1787432603.472895:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787432603.472901:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000019e53fe6/0xca72b3b33563ef39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d84 expref: 9 pid: 8430 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.472914:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000019e53fe6/0xca72b3b33563ef39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d84 expref: 9 pid: 8430 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.472949:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019e53fe6/0xca72b3b33563ef39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d84 expref: 9 pid: 8430 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.472967:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432603.472984:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432603.472992:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.473002:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef86 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.473036:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432603.473092:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2403:x1874258588374016:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 240us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432603.473101:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 53 00010000:00010000:1.0:1787432603.473419:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.473429:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.473453:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.473460:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.473468:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.473496:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432603.473502:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.473512:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.473524:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef86 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.473530:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cd5aa3d/0xca72b3b33563ef86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432603.473592:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2403:x1874258588373760:12345-192.168.204.24@tcp:1:lfs.0 Request processed in 20530us (22478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432603.473599:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 31 00000100:00100000:2.0:1787432603.479659:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432603.480378:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588374272 00000100:00100000:0.0:1787432603.480389:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588374272 00000100:00100000:0.0:1787432603.480455:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:0.0:1787432603.480466:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:11188:x1874258588374272:12345-192.168.204.24@tcp:35:lfs.0 00000004:00010000:0.0:1787432603.480544:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563ef78 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4da0 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787432603.480790:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1787432603.480848:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787432603.483593:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1787432603.483669:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ef8d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.483694:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ef1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d76 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.483703:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ef8d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.483764:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ef1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d76 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432603.483783:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ef1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d76 expref: 26 pid: 6513 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432603.483801:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d25180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6516:1874258609438592:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787432603.483901:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484122bfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432603.490436:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432603.490629:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d25180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6516:1874258609438592:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432603.490658:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ef8d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432603.490722:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588374400 00000100:00100000:1.0:1787432603.490741:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588374400 00010000:00010000:1.0:1787432603.490780:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ef1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d76 expref: 27 pid: 6513 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432603.490820:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 54 00000100:00100000:1.0:1787432603.490831:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:2403:x1874258588374400:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432603.490851:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432603.490859:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ef1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d76 expref: 27 pid: 6513 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.490891:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ef1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d76 expref: 27 pid: 6513 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.490916:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ef1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d76 expref: 27 pid: 6513 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.490945:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032ada00) 00010000:00010000:1.0:1787432603.490950:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ef8d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.490960:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ef8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.490968:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ef8d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.490996:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432603.491051:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+26:2403:x1874258588374400:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 222us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432603.491059:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 54 00010000:00010000:3.0:1787432603.491203:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ef8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432603.491210:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ef8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787432603.491329:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1787432603.491454:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1787432603.491560:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874258609438720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787432603.491609:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432603.491637:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787432603.491906:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609438720 00000100:00100000:1.0:1787432603.491911:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609438720 00000100:00100000:1.0:1787432603.491966:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787432603.491974:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1874258609438720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787432603.492052:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1874258609438720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 78us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432603.492059:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:3.0:1787432603.493203:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432603.493249:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874258609438720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787432603.493529:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1787432603.493607:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874258609438848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787432603.493652:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432603.493677:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483026db000 going to sleep for 11 seconds 00000100:00100000:0.0:1787432603.494117:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609438848 00000100:00100000:0.0:1787432603.494126:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609438848 00000100:00100000:0.0:1787432603.494220:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787432603.494229:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6516:x1874258609438848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787432603.494860:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6516:x1874258609438848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 629us (1205us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787432603.494870:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787432603.495881:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874258609438848:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787432603.497125:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1787432603.497240:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ef8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.497253:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ef8d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.497261:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ef8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.497286:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432603.497291:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ef8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.497299:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ef8d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.497316:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032ada00) 00010000:00010000:2.0:1787432603.497318:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787432603.497323:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ef8d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.497329:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563ef8d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787432603.497464:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787432603.497543:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787432603.497553:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 414589388069ns, next at 415589386025ns, rc = 0 00000001:00080000:2.0:1787432603.497560:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1787432603.497586:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032ada00) 00010000:00010000:2.0:1787432603.497589:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787432603.497597:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563ef78 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4da0 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432603.497738:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+29:11188:x1874258588374272:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 17273us (18087us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1787432603.497752:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 8 00000020:00080000:2.0:1787432603.497758:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787432603.501738:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432603.502369:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588374528 00000100:00100000:1.0:1787432603.502381:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588374528 00000100:00100000:1.0:1787432603.502447:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 54 00000100:00100000:1.0:1787432603.502458:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+29:11188:x1874258588374528:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787432603.502482:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432603.502516:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ef94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4da7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.502577:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ef94 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4da7 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.502592:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ef94 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4da7 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.502610:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:1.0:1787432603.502614:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787432603.502617:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851a00, rc 0) 00000100:00100000:1.0:1787432603.502755:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:11188:x1874258588374528:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 299us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432603.502763:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 54 00000100:00100000:1.0:1787432603.510522:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432603.510618:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588374784 00000100:00100000:3.0:1787432603.510630:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588374784 00000100:00100000:3.0:1787432603.510720:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:3.0:1787432603.510740:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948411a1c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:11188:x1874258588374784:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:3.0:1787432603.510988:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948411a1c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+31:11188:x1874258588374784:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 250us (475us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787432603.510996:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:1.0:1787432603.595942:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609438976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432603.596144:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432603.597136:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609438976 00000100:00100000:0.0:1787432603.597147:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609438976 00000100:00100000:0.0:1787432603.597235:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787432603.597247:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609438976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432603.597322:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432603.597392:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609438976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432603.597399:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787432603.604681:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609438976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432603.619276:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432603.619420:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588375040 00000100:00100000:3.0:1787432603.619430:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588375040 00000100:00100000:3.0:1787432603.619502:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 55 00000100:00100000:3.0:1787432603.619513:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+31:11198:x1874258588375040:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432603.619536:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432603.619556:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ef9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4dae expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432603.619661:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787432603.619774:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ef9b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dae expref: 33 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432603.619789:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766b00) 00010000:00010000:3.0:1787432603.619792:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432603.619796:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563ef9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dae expref: 33 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432603.619825:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303013e00, rc 0) 00000100:00100000:3.0:1787432603.619884:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+32:11198:x1874258588375040:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 373us (620us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1787432603.619892:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 55 00000100:00100000:0.0:1787432603.623513:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432603.623614:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588375168 00000100:00100000:1.0:1787432603.623624:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588375168 00000100:00100000:1.0:1787432603.623704:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 56 00000100:00100000:1.0:1787432603.623716:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+32:11198:x1874258588375168:12345-192.168.204.24@tcp:34:lfs.0 00010000:00010000:1.0:1787432603.623800:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563efa9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.623827:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563efa9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.623838:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563efa9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.623850:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563efb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.623857:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563efb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.623864:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563efb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.623939:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.623947:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.623952:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787432603.624004:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624016:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563efa9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624709:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563efa9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624717:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563efa9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624776:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850800 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432603.624780:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563efa9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624787:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563efa9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624801:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:1.0:1787432603.624804:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432603.624808:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563efa9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624813:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563efa9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624827:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563efb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624832:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563efb0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624837:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563efb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624842:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432603.624852:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563efb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624857:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563efb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624864:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9483032ad300) 00010000:00010000:1.0:1787432603.624867:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432603.624870:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563efb0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624875:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563efb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624885:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624890:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efb7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624895:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624899:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432603.624902:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624907:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624913:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:1.0:1787432603.624915:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432603.624922:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efb7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.624927:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efb7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432603.625599:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+32:11198:x1874258588375168:12345-192.168.204.24@tcp:34:lfs.0 Request processed in 1877us (2086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432603.625611:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 56 00000100:00100000:0.0:1787432603.632796:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432603.632938:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588375424 00000100:00100000:3.0:1787432603.632949:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588375424 00000100:00100000:3.0:1787432603.633014:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 10 00000100:00100000:3.0:1787432603.633034:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+32:11198:x1874258588375424:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:3.0:1787432603.633573:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+33:11198:x1874258588375424:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 540us (789us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787432603.633581:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 10 00000100:00100000:1.0:1787432603.688699:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432603.691581:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588375680 00000100:00100000:2.0:1787432603.691599:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588375680 00000100:00100000:2.0:1787432603.691811:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 57 00000100:00100000:2.0:1787432603.691824:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+33:11202:x1874258588375680:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432603.691858:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432603.691882:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563efbe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4db5 expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692124:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563efc5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692141:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563efc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692153:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563efc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692291:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563efcc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692301:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563efcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692308:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563efcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692439:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563efd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692448:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563efd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692473:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563efd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432603.692493:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787432603.692573:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563efc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692581:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563efc5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692589:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563efc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692595:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ea00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432603.692599:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563efc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692608:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563efc5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692635:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:2.0:1787432603.692639:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432603.692643:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563efc5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692649:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563efc5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692675:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563efcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692682:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563efcc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692695:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563efcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692699:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e800 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432603.692702:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563efcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692708:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563efcc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692716:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9483032ad300) 00010000:00010000:2.0:1787432603.692718:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432603.692721:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563efcc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692726:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563efcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692769:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563efbe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4db5 expref: 36 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692786:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563efd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4db5 expref: 35 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432603.692793:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:2.0:1787432603.692795:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432603.692798:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e400, rc 0) 00000100:00100000:2.0:1787432603.692885:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+35:11202:x1874258588375680:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1063us (4201us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787432603.692904:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 57 00000100:00100000:0.0:1787432603.697087:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432603.697660:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588375808 00000100:00100000:1.0:1787432603.697671:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588375808 00000100:00100000:1.0:1787432603.697746:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 58 00000100:00100000:1.0:1787432603.697758:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+35:11202:x1874258588375808:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:1.0:1787432603.697832:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efe1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.697851:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.697874:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.697915:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.697923:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efe1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.697930:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.697936:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432603.697941:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.697986:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efe1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.698000:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:1.0:1787432603.698003:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787432603.698008:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efe1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432603.698014:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563efe1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432603.698661:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+35:11202:x1874258588375808:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 901us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432603.698672:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 58 00000100:00100000:0.0:1787432603.715046:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432603.715206:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588376064 00000100:00100000:1.0:1787432603.715216:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588376064 00000100:00100000:1.0:1787432603.715275:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 11 00000100:00100000:1.0:1787432603.715285:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+35:11202:x1874258588376064:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:1.0:1787432603.715541:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+36:11202:x1874258588376064:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 256us (506us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787432603.715549:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 11 00010000:00010000:1.0:1787432603.852371:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432604.042585:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432604.044321:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588376320 00000100:00100000:0.0:1787432604.044334:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588376320 00000100:00100000:0.0:1787432604.044417:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 59 00000100:00100000:0.0:1787432604.044430:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+36:11233:x1874258588376320:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787432604.044453:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432604.044473:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563efe8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4dbc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.044771:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563efef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.044786:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563efef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.044800:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563efef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432604.044811:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787432604.044929:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563efe8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dbc expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.044949:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563efef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dbc expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.044971:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:0.0:1787432604.044973:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432604.044977:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948400030e00, rc 0) 00000100:00100000:0.0:1787432604.045044:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+38:11233:x1874258588376320:12345-192.168.204.24@tcp:101:cat.0 Request processed in 618us (2469us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787432604.045051:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 59 00000100:00080000:3.0:1787432604.045651:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432604.052250:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432604.052297:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432604.052420:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588376704 00000100:00100000:3.0:1787432604.052431:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588376704 00000100:00100000:3.0:1787432604.052503:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:3.0:1787432604.052515:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+38:11233:x1874258588376704:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:3.0:1787432604.052835:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+39:11233:x1874258588376704:12345-192.168.204.24@tcp:35:cat.0 Request processed in 322us (536us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1787432604.052843:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:1.0:1787432604.053342:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588376448 00000100:00100000:1.0:1787432604.053348:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588376448 00000100:00100000:1.0:1787432604.053396:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 4 00000100:00100000:1.0:1787432604.053404:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+39:2403:x1874258588376448:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432604.053415:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432604.053448:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563efef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dbc expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.053465:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:1.0:1787432604.053469:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432604.053513:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+38:2403:x1874258588376448:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 110us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432604.053519:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 4 00000100:00100000:0.0:1787432604.146783:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432604.147665:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588376960 00000100:00100000:2.0:1787432604.147680:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588376960 00000100:00100000:2.0:1787432604.147754:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 60 00000100:00100000:2.0:1787432604.147765:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+38:11239:x1874258588376960:12345-192.168.204.24@tcp:101:dd.0 00010000:00010000:2.0:1787432604.147791:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432604.147794:0:9020:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787432604.147819:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563ef55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d92 expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432604.147840:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:2.0:1787432604.147845:0:9020:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432604.147858:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563effd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4dc3 expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432604.147988:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f004 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432604.148003:0:9020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563efd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4db5 expref: 38 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432604.148021:0:9020:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f004 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432604.148057:0:9020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563efd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4db5 expref: 38 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432604.148083:0:9020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563efd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4db5 expref: 38 pid: 9020 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432604.148098:0:9020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b49500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9020:1874258609439104:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432604.148277:0:9020:0:(client.c:2715:ptlrpc_set_wait()) set ffff948412a70000 going to sleep for 11 seconds 00000100:00100000:0.0:1787432604.157968:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432604.158056:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588377088 00000100:00100000:1.0:1787432604.158066:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588377088 00010000:00010000:1.0:1787432604.158107:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563efd3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4db5 expref: 39 pid: 9020 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432604.158162:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 55 00000100:00100000:1.0:1787432604.158219:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302767800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+39:2403:x1874258588377088:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432604.158235:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432604.158244:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563efd3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4db5 expref: 39 pid: 9020 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.158260:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563efd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4db5 expref: 39 pid: 9020 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.158282:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:1.0:1787432604.158287:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f004 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.158297:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f004 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.158325:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f004 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.158343:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432604.158394:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302767800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+39:2403:x1874258588377088:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 178us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432604.158401:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 55 00010000:00010000:2.0:1787432604.158968:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563efd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4db5 expref: 38 pid: 9020 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432604.158994:0:9020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b49500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9020:1874258609439104:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432604.159016:0:9020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f004 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432604.159025:0:9020:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f004 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432604.159031:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f004 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432604.159052:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787432604.159274:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563effd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dc3 expref: 39 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432604.159290:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f004 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dc3 expref: 38 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432604.159299:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:2.0:1787432604.159310:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787432604.159313:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e800, rc 0) 00000100:00100000:2.0:1787432604.159352:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+38:11239:x1874258588376960:12345-192.168.204.24@tcp:101:dd.0 Request processed in 11588us (12579us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787432604.159359:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 60 00000100:00100000:0.0:1787432604.163928:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432604.164056:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588377216 00000100:00100000:1.0:1787432604.164066:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588377216 00000100:00100000:1.0:1787432604.164131:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 61 00000100:00100000:1.0:1787432604.164152:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+38:11239:x1874258588377216:12345-192.168.204.24@tcp:101:dd.0 00010000:00010000:1.0:1787432604.164211:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432604.164233:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f012 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4dca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.164271:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f019 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.164286:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.164298:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.164431:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f012 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dca expref: 40 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.164450:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dca expref: 39 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.164642:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:1.0:1787432604.164645:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787432604.164649:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850800, rc 0) 00000100:00100000:1.0:1787432604.164707:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+39:11239:x1874258588377216:12345-192.168.204.24@tcp:101:dd.0 Request processed in 557us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432604.164715:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 61 00000100:00100000:1.0:1787432604.170612:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432604.170669:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588377472 00000100:00100000:3.0:1787432604.170681:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588377472 00000100:00100000:3.0:1787432604.170741:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 62 00000100:00100000:3.0:1787432604.170752:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+39:11239:x1874258588377472:12345-192.168.204.24@tcp:36:dd.0 00010000:00010000:3.0:1787432604.171006:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f020 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432604.171709:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f020 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432604.171722:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f020 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787432604.171777:0:10165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1787432604.171807:0:10165:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d608712 reply state 00000000e00472e5 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f020 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432604.171820:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f020 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432604.171828:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:3.0:1787432604.171831:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787432604.171834:0:10165:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787432604.171930:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+42:11239:x1874258588377472:12345-192.168.204.24@tcp:36:dd.0 Request processed in 1177us (1326us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1787432604.171939:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 62 00000020:00080000:3.0:1787432604.171944:0:10165:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787432604.194588:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432604.194638:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432604.194995:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588377728 00000100:00100000:1.0:1787432604.195007:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588377728 00000100:00100000:1.0:1787432604.195099:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 309 00000100:00100000:1.0:1787432604.195110:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588377728:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432604.195223:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588377728:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 115us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432604.195232:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 309 00000100:00100000:2.0:1787432604.195458:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588377600 00000100:00100000:2.0:1787432604.195463:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588377600 00000100:00100000:2.0:1787432604.195510:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 387 00000100:00100000:2.0:1787432604.195518:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588377600:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432604.195559:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588377600:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 42us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432604.195566:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 387 00000100:00080000:3.0:1787432604.195690:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787432604.204851:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432604.204895:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432604.204926:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432604.205046:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588377984 00000100:00100000:0.0:1787432604.205054:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588377984 00000100:00100000:0.0:1787432604.205124:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588378112 00000100:00100000:0.0:1787432604.205127:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588378112 00000100:00100000:0.0:1787432604.205198:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 310 00000100:00100000:0.0:1787432604.205210:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588377984:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432604.205285:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588377984:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 77us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432604.205294:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 310 00000100:00100000:0.0:1787432604.205313:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 311 00000100:00100000:0.0:1787432604.205320:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588378112:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432604.205346:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588378112:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432604.205370:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 311 00000100:00080000:3.0:1787432604.205755:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432604.205760:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432604.205880:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588377856 00000100:00100000:2.0:1787432604.205885:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588377856 00000100:00100000:2.0:1787432604.205927:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 84 00000100:00100000:2.0:1787432604.205935:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2401:x1874258588377856:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432604.205981:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2401:x1874258588377856:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 48us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432604.205987:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 84 00000100:00100000:0.0:1787432604.649699:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432604.649773:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588378240 00000100:00100000:1.0:1787432604.649784:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588378240 00000100:00100000:1.0:1787432604.649852:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 63 00000100:00100000:1.0:1787432604.649863:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+42:11253:x1874258588378240:12345-192.168.204.24@tcp:101:stat.0 00010000:00010000:1.0:1787432604.649893:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432604.649920:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f027 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4dd1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.650000:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f02e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.650017:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f02e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.650046:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f02e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.650059:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f035 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.650067:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.650074:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.650148:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f03c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.650159:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f004 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dc3 expref: 43 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.650214:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f03c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.650254:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f004 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dc3 expref: 43 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.650267:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f004 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dc3 expref: 43 pid: 9020 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432604.650284:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304435c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874258609439232:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432604.650425:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303015f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432604.656151:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432604.656323:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588378496 00000100:00100000:3.0:1787432604.656333:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588378496 00000100:00100000:3.0:1787432604.656425:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 13 00000100:00100000:3.0:1787432604.656436:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+44:6171:x1874258588378496:12345-192.168.204.24@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787432604.656802:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+45:6171:x1874258588378496:12345-192.168.204.24@tcp:35:ldlm_bl.0 Request processed in 366us (661us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787432604.656810:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 13 00000100:00100000:1.0:1787432604.658192:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304435c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874258609439232:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432604.658221:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f03c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432604.667579:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432604.669102:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588378624 00000100:00100000:1.0:1787432604.669126:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588378624 00010000:00010000:1.0:1787432604.669243:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f004 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dc3 expref: 45 pid: 9020 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432604.669298:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 56 00000100:00100000:1.0:1787432604.669310:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830383b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+45:2402:x1874258588378624:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432604.669328:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432604.669334:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f004 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dc3 expref: 45 pid: 9020 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.669348:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f004 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dc3 expref: 45 pid: 9020 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.669372:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f004 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dc3 expref: 45 pid: 9020 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.669399:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:1.0:1787432604.669404:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f03c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.669414:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f03c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.669423:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f03c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432604.669484:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432604.669565:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830383b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+44:2402:x1874258588378624:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 256us (1995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432604.669574:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 56 00010000:00010000:0.0:1787432604.669871:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f03c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.669879:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f03c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432604.669963:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787432604.669968:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787432604.670011:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f03c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.670025:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f03c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.670034:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f02e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.670041:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f02e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.670049:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f02e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.670055:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432604.670060:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f02e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.670084:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f02e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.670095:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:0.0:1787432604.670098:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432604.670101:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f02e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.670106:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f02e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.670117:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.670122:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f035 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.670128:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f035 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.670133:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432604.670135:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f035 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.670141:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f035 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.670148:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9483032ad300) 00010000:00010000:0.0:1787432604.670151:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432604.670153:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f035 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.670231:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f035 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.670272:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f027 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dd1 expref: 44 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.670287:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f03c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dd1 expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432604.670295:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:0.0:1787432604.670297:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432604.670300:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850e00, rc 0) 00000100:00100000:0.0:1787432604.670334:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+43:11253:x1874258588378240:12345-192.168.204.24@tcp:101:stat.0 Request processed in 20472us (20648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432604.670341:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 63 00000100:00100000:0.0:1787432604.786995:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432604.787265:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588378880 00000100:00100000:3.0:1787432604.787279:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588378880 00000100:00100000:3.0:1787432604.787348:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 64 00000100:00100000:3.0:1787432604.787359:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830383b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+43:11259:x1874258588378880:12345-192.168.204.24@tcp:36:truncate.0 00010000:00010000:3.0:1787432604.787418:0:10165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432604.787448:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f03c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dd1 expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432604.787485:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:3.0:1787432604.787490:0:10165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432604.787661:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f043 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432604.787676:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f043 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432604.787686:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f043 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787432604.787769:0:10165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1787432604.787790:0:10165:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e7e885c reply state 0000000051ddf776 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f043 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432604.787802:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f043 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432604.787817:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:3.0:1787432604.787820:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787432604.787822:0:10165:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787432604.787940:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830383b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+45:11259:x1874258588378880:12345-192.168.204.24@tcp:36:truncate.0 Request processed in 582us (955us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787432604.787948:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 64 00000020:00080000:3.0:1787432604.787953:0:10165:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787432604.875588:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432605.009279:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432605.009408:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588379008 00000100:00100000:1.0:1787432605.009418:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588379008 00000100:00100000:1.0:1787432605.009488:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 65 00000100:00100000:1.0:1787432605.009500:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+45:11273:x1874258588379008:12345-192.168.204.24@tcp:101:stat.0 00010000:00010000:1.0:1787432605.009524:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432605.009547:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f04a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4dd8 expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.009711:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f051 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.009727:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f051 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.009739:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f051 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.009753:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f058 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.009759:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f058 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.009764:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f058 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.009856:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f05f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.009865:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f05f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.009872:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f05f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432605.009913:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1787432605.009917:0:9020:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432605.009941:0:9020:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f05f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.009954:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f05f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.009962:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f051 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.009969:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f051 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.009976:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f051 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.009991:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432605.009995:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f051 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.010003:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f051 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.010021:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:1.0:1787432605.010024:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432605.010029:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f051 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.010035:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f051 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.010048:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f058 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.010054:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f058 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.010060:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f058 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.010066:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432605.010069:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f058 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.010075:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f058 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.010083:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9483032ad300) 00010000:00010000:1.0:1787432605.010085:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432605.010088:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f058 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.010093:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f058 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.010129:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f04a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dd8 expref: 47 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.010143:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f05f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dd8 expref: 46 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.010151:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:1.0:1787432605.010152:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432605.010155:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850400, rc 0) 00000100:00100000:1.0:1787432605.010274:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+46:11273:x1874258588379008:12345-192.168.204.24@tcp:101:stat.0 Request processed in 776us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432605.010282:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 65 00000100:00100000:2.0:1787432605.116760:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432605.116857:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588379264 00000100:00100000:0.0:1787432605.116868:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588379264 00000100:00100000:0.0:1787432605.116939:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 66 00000100:00100000:0.0:1787432605.116950:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+46:11283:x1874258588379264:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787432605.116974:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432605.116996:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030c00/0xca72b3b33563f066 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4ddf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432605.117107:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787432605.117266:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030c00/0xca72b3b33563f066 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ddf expref: 48 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.117299:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766b00) 00010000:00010000:0.0:1787432605.117301:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787432605.117307:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030c00/0xca72b3b33563f066 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ddf expref: 48 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.117344:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948400030c00, rc 0) 00000100:00100000:0.0:1787432605.117413:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+47:11283:x1874258588379264:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 465us (665us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1787432605.117421:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 66 00000100:00100000:2.0:1787432605.122103:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432605.122471:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588379520 00000100:00100000:3.0:1787432605.122482:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588379520 00000100:00100000:3.0:1787432605.122546:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00100000:3.0:1787432605.122557:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+47:11283:x1874258588379520:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:3.0:1787432605.122776:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+48:11283:x1874258588379520:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 221us (685us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1787432605.122784:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00100000:2.0:1787432605.216072:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432605.216327:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588379776 00000100:00100000:1.0:1787432605.216339:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588379776 00000100:00100000:1.0:1787432605.216424:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 67 00000100:00100000:1.0:1787432605.216435:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+48:11289:x1874258588379776:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787432605.216470:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432605.216495:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f074 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4de6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.216647:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f07b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.216663:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f05f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dd8 expref: 49 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.216673:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f07b lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.216712:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f05f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dd8 expref: 49 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.216726:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f05f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dd8 expref: 49 pid: 9020 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432605.216738:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304435c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1874258609439360:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432605.216839:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303015f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432605.224132:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432605.224953:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588379904 00000100:00100000:3.0:1787432605.224965:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588379904 00010000:00010000:3.0:1787432605.225030:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f05f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dd8 expref: 50 pid: 9020 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432605.225079:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 57 00000100:00100000:3.0:1787432605.225091:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94841223dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+50:2402:x1874258588379904:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432605.225107:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432605.225114:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f05f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dd8 expref: 50 pid: 9020 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.225128:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f05f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dd8 expref: 50 pid: 9020 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.225218:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:3.0:1787432605.225223:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f07b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.225234:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f07b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.225243:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f07b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.225265:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432605.225347:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94841223dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+50:2402:x1874258588379904:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 257us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432605.225356:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 57 00010000:00010000:2.0:1787432605.226231:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f05f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dd8 expref: 49 pid: 9020 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432605.226253:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304435c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1874258609439360:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432605.226287:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f07b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.226297:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f07b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.226302:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f07b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432605.226324:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1787432605.226505:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f074 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4de6 expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.226521:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f07b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4de6 expref: 49 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.226529:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:2.0:1787432605.226532:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787432605.226534:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850000, rc 0) 00000100:00100000:2.0:1787432605.226583:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+49:11289:x1874258588379776:12345-192.168.204.24@tcp:101:bash.0 Request processed in 10150us (10522us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787432605.226591:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 67 00000100:00100000:1.0:1787432605.236545:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432605.236775:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588380160 00000100:00100000:0.0:1787432605.236798:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588380160 00000100:00100000:0.0:1787432605.236865:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 68 00000100:00100000:0.0:1787432605.236875:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+49:11289:x1874258588380160:12345-192.168.204.24@tcp:36:bash.0 00010000:00010000:0.0:1787432605.237229:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f089 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.237250:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f089 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.237262:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f089 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787432605.237342:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1787432605.237367:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000400d363 reply state 000000004ca2c0a4 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f089 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.237380:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f089 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.237396:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:0.0:1787432605.237412:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787432605.237417:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787432605.237541:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+52:11289:x1874258588380160:12345-192.168.204.24@tcp:36:bash.0 Request processed in 666us (1010us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1787432605.237549:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 68 00000020:00080000:0.0:1787432605.237555:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787432605.245601:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432605.245691:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588380288 00000100:00100000:3.0:1787432605.245703:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588380288 00000100:00100000:3.0:1787432605.245818:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 69 00000100:00100000:3.0:1787432605.245830:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+52:11289:x1874258588380288:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787432605.245853:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432605.245873:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f090 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4ded expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.245985:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f097 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.246001:0:10165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f07b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4de6 expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.246046:0:10165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f097 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.246086:0:10165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f07b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4de6 expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.246099:0:10165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f07b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4de6 expref: 53 pid: 6513 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432605.246113:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f919c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609439488:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432605.246256:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483026db000 going to sleep for 11 seconds 00000100:00100000:1.0:1787432605.252846:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432605.253141:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f919c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609439488:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432605.253260:0:10165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f097 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432605.253334:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588380416 00000100:00100000:0.0:1787432605.253343:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588380416 00010000:00010000:0.0:1787432605.253379:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f07b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4de6 expref: 54 pid: 6513 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432605.253550:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 58 00000100:00100000:0.0:1787432605.253561:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304434380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+54:2403:x1874258588380416:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432605.253577:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432605.253585:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f07b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4de6 expref: 54 pid: 6513 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.253597:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f07b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4de6 expref: 54 pid: 6513 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.253619:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f07b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4de6 expref: 54 pid: 6513 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.253635:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:0.0:1787432605.253640:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f097 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.253670:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.253677:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f097 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.253719:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432605.253770:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304434380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+53:2403:x1874258588380416:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 210us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432605.253776:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 58 00010000:00010000:1.0:1787432605.254603:0:10165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.254614:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432605.254670:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787432605.254675:0:10165:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432605.254704:0:10165:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.254740:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f090 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ded expref: 53 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.254755:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f097 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ded expref: 52 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.254778:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:1.0:1787432605.254780:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432605.255010:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303012400, rc 0) 00000100:00100000:1.0:1787432605.255067:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+52:11289:x1874258588380288:12345-192.168.204.24@tcp:101:bash.0 Request processed in 9239us (9478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432605.255076:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 69 00000100:00100000:1.0:1787432605.263669:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432605.266022:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588380672 00000100:00100000:3.0:1787432605.266042:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588380672 00000100:00100000:3.0:1787432605.266198:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00100000:3.0:1787432605.266211:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948411a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+52:11289:x1874258588380672:12345-192.168.204.24@tcp:35:bash.0 00000100:00100000:3.0:1787432605.266462:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948411a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+53:11289:x1874258588380672:12345-192.168.204.24@tcp:35:bash.0 Request processed in 244us (3555us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1787432605.266470:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00100000:0.0:1787432605.405043:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432605.405261:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588380928 00000100:00100000:2.0:1787432605.405273:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588380928 00000100:00100000:2.0:1787432605.405345:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 70 00000100:00100000:2.0:1787432605.405356:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+53:11299:x1874258588380928:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432605.405386:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432605.405526:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f09e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4df4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432605.405650:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787432605.405754:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f09e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4df4 expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.405769:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766b00) 00010000:00010000:2.0:1787432605.405772:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787432605.405777:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f09e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4df4 expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.405798:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e600, rc 0) 00000100:00100000:2.0:1787432605.405920:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+54:11299:x1874258588380928:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 565us (895us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1787432605.405929:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 70 00000100:00100000:1.0:1787432605.413479:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432605.413642:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588381056 00000100:00100000:0.0:1787432605.413654:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588381056 00000100:00100000:0.0:1787432605.413731:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 71 00000100:00100000:0.0:1787432605.413741:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+54:11299:x1874258588381056:12345-192.168.204.24@tcp:34:lfs.0 00010000:00010000:0.0:1787432605.413828:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f0ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.413847:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f0ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.413860:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f0ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.413871:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030c00/0xca72b3b33563f0b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.413878:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030c00/0xca72b3b33563f0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.413918:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030c00/0xca72b3b33563f0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414009:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f0ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414019:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414037:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787432605.414090:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414104:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f0ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414111:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f0ac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414118:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f0ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414124:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400031600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432605.414129:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f0ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414137:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f0ac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414159:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:0.0:1787432605.414210:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432605.414215:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f0ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414222:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f0ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414239:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030c00/0xca72b3b33563f0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414245:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400030c00/0xca72b3b33563f0b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414250:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948400030c00/0xca72b3b33563f0b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414255:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432605.414258:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030c00/0xca72b3b33563f0b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414263:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030c00/0xca72b3b33563f0b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414271:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9483032ad300) 00010000:00010000:0.0:1787432605.414274:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432605.414277:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948400030c00/0xca72b3b33563f0b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414282:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030c00/0xca72b3b33563f0b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414291:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414302:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f0ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414308:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f0ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414312:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432605.414315:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f0ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414320:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f0ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414328:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:0.0:1787432605.414330:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432605.414333:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f0ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.414337:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f0ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432605.414545:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+54:11299:x1874258588381056:12345-192.168.204.24@tcp:34:lfs.0 Request processed in 803us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432605.414553:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 71 00000100:00100000:1.0:1787432605.419795:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432605.420272:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588381312 00000100:00100000:0.0:1787432605.420284:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588381312 00000100:00100000:0.0:1787432605.420348:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:0.0:1787432605.420361:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+54:11299:x1874258588381312:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:0.0:1787432605.420619:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+55:11299:x1874258588381312:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 260us (835us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787432605.420641:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:1.0:1787432605.494002:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432605.495013:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588381568 00000100:00100000:3.0:1787432605.495083:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588381568 00000100:00100000:3.0:1787432605.495335:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 72 00000100:00100000:3.0:1787432605.495347:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+55:11302:x1874258588381568:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432605.495386:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432605.495514:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f0c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4dfb expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.495588:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f0c8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.495602:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f0c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.495614:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f0c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.495625:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563f0cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.495632:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563f0cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.495638:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563f0cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.495949:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f0d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.495959:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.495966:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432605.495975:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787432605.496119:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f0c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.496127:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f0c8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.496134:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f0c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.496139:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432605.496226:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f0c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.496235:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f0c8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.496246:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:3.0:1787432605.496249:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432605.496253:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f0c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.496259:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f0c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.496274:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563f0cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.496279:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563f0cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.496286:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563f0cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.496300:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fce00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432605.496303:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563f0cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.496309:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563f0cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.496315:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9483032ad300) 00010000:00010000:3.0:1787432605.496317:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432605.496320:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563f0cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.496325:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563f0cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.496359:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f0c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dfb expref: 58 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.496371:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f0d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dfb expref: 57 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.496378:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:3.0:1787432605.496380:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432605.496382:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fdc00, rc 0) 00000100:00100000:3.0:1787432605.496702:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+57:11302:x1874258588381568:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1356us (2708us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1787432605.496710:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 72 00000100:00100000:1.0:1787432605.502423:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432605.502482:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432605.502624:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588381696 00000100:00100000:2.0:1787432605.502635:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588381696 00000100:00100000:2.0:1787432605.502716:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 73 00000100:00100000:2.0:1787432605.502727:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+57:11302:x1874258588381696:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:2.0:1787432605.502806:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f0e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.502827:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.502841:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.502887:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.502908:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f0e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.502915:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f0e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.502922:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432605.502927:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f0e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.502935:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f0e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.502948:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:2.0:1787432605.502951:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787432605.502957:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f0e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.502963:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f0e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432605.503065:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+57:11302:x1874258588381696:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 338us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432605.503074:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 73 00000100:00100000:3.0:1787432605.503632:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588381824 00000100:00100000:3.0:1787432605.503646:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588381824 00000100:00100000:3.0:1787432605.503683:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 5 00000100:00100000:3.0:1787432605.503690:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304436680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+57:2402:x1874258588381824:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432605.503701:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432605.503718:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f0d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dfb expref: 57 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.503732:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:3.0:1787432605.503737:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432605.503772:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304436680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+56:2402:x1874258588381824:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 82us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432605.503779:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 5 00000100:00100000:1.0:1787432605.508479:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432605.508622:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588382080 00000100:00100000:0.0:1787432605.508633:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588382080 00000100:00100000:0.0:1787432605.508697:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:0.0:1787432605.508710:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+56:11302:x1874258588382080:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:0.0:1787432605.508953:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+57:11302:x1874258588382080:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 245us (483us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787432605.508962:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 17 00000001:00080000:2.0:1787432605.649848:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:2.0:1787432605.649911:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787432605.649935:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9483026db9c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787432605.649940:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948434bb4900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9483026db780 00000020:00080000:2.0:1787432605.649943:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948434bb4200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff948303196000 00000020:00080000:0.0:1787432605.652190:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1787432605.652406:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787432605.657465:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432605.657493:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609439616:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787432605.657575:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432605.657725:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609439616 00000100:00100000:3.0:1787432605.657734:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609439616 00000100:00100000:3.0:1787432605.657807:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787432605.657819:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1874258609439616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787432605.657846:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1787432605.657878:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a8a0e9a, atime: 0x6a8a0e9b, ctime: 0x6a8a0e9a, blocks: 0x8 00010000:00010000:3.0:1787432605.657886:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045e7470a/0xca72b3b33563f0eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.657902:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1787432605.657907:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432605.657914:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045e7470a/0xca72b3b33563f0eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.657931:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045e7470a/0xca72b3b33563f0eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.657955:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045e7470a/0xca72b3b33563f0eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.657964:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045e7470a/0xca72b3b33563f0eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.657983:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787432605.658156:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3642:x1874258609439616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 327us (568us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787432605.658195:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1787432605.658219:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432605.658225:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045e7470a/0xca72b3b33563f0eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.658233:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fdc00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432605.658237:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045e7470a/0xca72b3b33563f0eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.658246:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045e7470a/0xca72b3b33563f0eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.658263:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045e7470a/0xca72b3b33563f0eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.658270:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045e7470a/0xca72b3b33563f0eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.658295:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432605.658298:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432605.658300:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787432605.658337:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94843f919c00/2, rc 0, transno 4294967302 00000100:00100000:3.0:1787432605.658343:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609439616:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1787432605.658544:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787432605.660796:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563eed0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.660813:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563eed0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.660821:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563eed0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.660828:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303012200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432605.660833:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563eed0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.660840:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563eed0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.660873:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff948435957400) 00010000:00010000:1.0:1787432605.660877:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432605.660880:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563eed0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.660887:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563eed0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.660908:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563eed7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.660914:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563eed7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.660919:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563eed7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.660924:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432605.660926:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563eed7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.660932:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563eed7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.660939:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:1.0:1787432605.660941:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432605.660944:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563eed7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.660950:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563eed7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.660978:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563ef16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.660985:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563ef16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.660991:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563ef16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.660996:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432605.660999:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563ef16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661004:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563ef16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661012:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9483032ad300) 00010000:00010000:1.0:1787432605.661015:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432605.661018:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563ef16 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661109:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563ef16 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661125:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f020 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661131:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f020 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661137:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f020 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661262:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432605.661265:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f020 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661270:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f020 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661279:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:1.0:1787432605.661281:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432605.661283:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f020 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661288:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f020 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661299:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f043 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661304:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f043 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661309:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f043 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661314:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303012000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432605.661317:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f043 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661323:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f043 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661341:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:1.0:1787432605.661344:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432605.661346:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f043 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661351:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f043 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661362:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f089 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661368:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f089 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661374:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f089 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661378:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432605.661381:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f089 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661385:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f089 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661391:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:1.0:1787432605.661393:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432605.661396:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f089 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432605.661401:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f089 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432605.667369:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432605.667454:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588382336 00000100:00100000:0.0:1787432605.667465:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588382336 00000100:00100000:0.0:1787432605.667526:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 74 00000100:00100000:0.0:1787432605.667535:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+12:11320:x1874258588382336:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787432605.667559:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432605.667578:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030c00/0xca72b3b33563f0f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e02 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.667705:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f0f9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.667719:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.667731:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432605.667743:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787432605.667869:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030c00/0xca72b3b33563f0f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e02 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.667890:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f0f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e02 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432605.667898:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:0.0:1787432605.667900:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787432605.667904:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948400031600, rc 0) 00000100:00100000:0.0:1787432605.667967:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:11320:x1874258588382336:12345-192.168.204.24@tcp:101:cat.0 Request processed in 433us (610us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1787432605.667975:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 74 00000100:00100000:1.0:1787432605.695455:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432605.695763:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588382464 00000100:00100000:3.0:1787432605.695774:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588382464 00000100:00100000:3.0:1787432605.695839:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 75 00000100:00100000:3.0:1787432605.695850:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:11321:x1874258588382464:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432605.695874:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432605.695895:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f107 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e09 expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.695967:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563f10e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.695984:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563f10e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.695999:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563f10e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432605.696063:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787432605.696068:0:10165:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787432605.696089:0:10165:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563f10e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.696116:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f107 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e09 expref: 16 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.696221:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563f10e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e09 expref: 15 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.696231:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:3.0:1787432605.696234:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432605.696238:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fce00, rc 0) 00000100:00100000:3.0:1787432605.696319:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:11321:x1874258588382464:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 471us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432605.696327:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 75 00000100:00100000:1.0:1787432605.704864:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432605.704956:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588382848 00000100:00100000:0.0:1787432605.704965:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588382848 00000100:00100000:0.0:1787432605.705020:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00100000:0.0:1787432605.705041:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:11321:x1874258588382848:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:0.0:1787432605.705362:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:11321:x1874258588382848:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 323us (506us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1787432605.705370:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00100000:1.0:1787432605.709156:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432605.709284:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588382976 00000100:00100000:3.0:1787432605.709295:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588382976 00000100:00100000:3.0:1787432605.709412:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 6 00000100:00100000:3.0:1787432605.709423:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405564000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:11321:x1874258588382976:12345-192.168.204.24@tcp:103:lfs.0 00010000:00010000:3.0:1787432605.709442:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787432605.709480:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f097 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ded expref: 16 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.709504:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f0f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e02 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.709517:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563ef94 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4da7 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432605.709528:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:3.0:1787432605.709533:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432605.709614:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405564000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+13:11321:x1874258588382976:12345-192.168.204.24@tcp:103:lfs.0 Request processed in 192us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432605.709622:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 6 00000100:00100000:1.0:1787432605.713611:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432605.713754:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588383104 00000100:00100000:2.0:1787432605.713763:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588383104 00000100:00100000:2.0:1787432605.713879:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 76 00000100:00100000:2.0:1787432605.713892:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+13:11321:x1874258588383104:12345-192.168.204.24@tcp:58:lfs.0 00010000:00010000:2.0:1787432605.714454:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f115 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.714475:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f115 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.714487:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f115 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787432605.714752:0:9020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432605.714903:0:9020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787432605.714998:0:9020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787432605.715404:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+13:11321:x1874258588383104:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 1509us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432605.715415:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 76 00000100:00100000:1.0:1787432605.744878:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432605.747362:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588383232 00000100:00100000:2.0:1787432605.747378:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588383232 00000100:00100000:2.0:1787432605.747797:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 77 00000100:00100000:2.0:1787432605.747810:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+13:11323:x1874258588383232:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432605.747831:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432605.747865:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f11c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e10 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.747951:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f123 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.747964:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f123 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.747975:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f123 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.747999:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f12a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748005:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f12a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748011:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f12a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748096:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f131 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748105:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f131 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748112:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f131 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432605.748201:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787432605.748205:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787432605.748223:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f131 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748241:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f131 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748250:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f123 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748257:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f123 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748264:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f123 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748270:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85f200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432605.748275:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f123 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748281:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f123 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748292:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:2.0:1787432605.748296:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432605.748299:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f123 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748306:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f123 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748325:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f12a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748330:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f12a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748341:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f12a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748347:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ee00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432605.748349:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f12a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748356:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f12a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748363:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948420766100) 00010000:00010000:2.0:1787432605.748365:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432605.748368:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f12a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748374:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f12a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748418:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f11c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e10 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748432:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f131 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e10 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432605.748440:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:2.0:1787432605.748452:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432605.748455:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85fc00, rc 0) 00000100:00100000:2.0:1787432605.748524:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:11323:x1874258588383232:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 717us (3656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432605.748544:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 77 00010000:00010000:1.0:1787432605.901577:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787432606.155406:0:13810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787432606.155420:0:13810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787432606.156339:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787432606.156350:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787432606.156504:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b48700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13810:1874258609439744:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787432606.156994:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff948406cb5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432606.167329:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432606.167455:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b48700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13810:1874258609439744:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787432606.167729:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588383360 00000100:00100000:3.0:1787432606.167736:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588383360 00000100:00100000:3.0:1787432606.167832:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 78 00000100:00100000:3.0:1787432606.167841:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:11334:x1874258588383360:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787432606.167873:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787432606.168029:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:11334:x1874258588383360:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 188us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432606.168039:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 78 00000100:00100000:3.0:1787432606.171455:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432606.171533:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588383488 00000100:00100000:1.0:1787432606.171544:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588383488 00000100:00100000:1.0:1787432606.171606:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 79 00000100:00100000:1.0:1787432606.171617:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:11334:x1874258588383488:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787432606.171715:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f138 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.171733:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f138 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.171748:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f138 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.171805:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f13f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.171813:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f13f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.171819:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f13f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.171869:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f146 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.171877:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f146 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.171884:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f146 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432606.171932:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787432606.171937:0:9020:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432606.171950:0:9020:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f146 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.171962:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f138 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.171969:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f138 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.171977:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f138 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.171984:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432606.171989:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f138 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.171996:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f138 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.172010:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94841318b400) 00010000:00010000:1.0:1787432606.172019:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432606.172023:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f138 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.172029:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f138 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.172043:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f13f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.172048:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f13f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.172053:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f13f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.172057:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432606.172059:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f13f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.172064:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f13f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.172070:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9483032ad300) 00010000:00010000:1.0:1787432606.172073:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432606.172075:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f13f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.172080:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f13f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.172093:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f146 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.172104:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f146 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.172109:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f146 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.172114:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432606.172118:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f146 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.172124:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f146 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.172144:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:1.0:1787432606.172147:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432606.172150:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f146 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.172154:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f146 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432606.172257:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:11334:x1874258588383488:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 641us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432606.172266:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 79 00000100:00080000:2.0:1787432606.178614:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432606.179870:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432606.179944:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588383744 00000100:00100000:2.0:1787432606.179956:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588383744 00000100:00100000:2.0:1787432606.180020:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 80 00000100:00100000:2.0:1787432606.180031:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:11334:x1874258588383744:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787432606.180054:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432606.180075:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f14d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e17 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.180231:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f154 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.180247:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.180260:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432606.180273:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787432606.180389:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.180396:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f154 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.180403:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f154 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.180409:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ee00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432606.180414:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f154 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.180422:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f154 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.180448:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:2.0:1787432606.180451:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432606.180456:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f154 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.180462:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f154 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.180512:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f14d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e17 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.180522:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94841318b400) 00010000:00010000:2.0:1787432606.180525:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787432606.180529:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f14d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e17 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.180550:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85f200, rc 0) 00000100:00100000:2.0:1787432606.180614:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:11334:x1874258588383744:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 585us (752us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1787432606.180622:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 80 00000100:00100000:0.0:1787432606.188454:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432606.188540:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588383872 00000100:00100000:2.0:1787432606.188550:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588383872 00000100:00100000:2.0:1787432606.188617:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 81 00000100:00100000:2.0:1787432606.188628:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830383b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:11334:x1874258588383872:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787432606.188680:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787432606.188812:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830383b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:11334:x1874258588383872:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 185us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432606.188821:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 81 00000100:00100000:0.0:1787432606.199891:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432606.203506:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588384128 00000100:00100000:3.0:1787432606.203522:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588384128 00000100:00100000:3.0:1787432606.204914:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 82 00000100:00100000:3.0:1787432606.204928:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:11334:x1874258588384128:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432606.204949:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432606.204952:0:10165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787432606.204980:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563f10e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e09 expref: 15 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.205000:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:3.0:1787432606.205006:0:10165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432606.205020:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f162 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e1e expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787432606.205468:0:10165:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787432606.205635:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33563f169 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.205650:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33563f169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.205661:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33563f169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.205727:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f162 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e1e expref: 17 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.205744:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33563f169 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e1e expref: 16 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.205752:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948435957a00) 00010000:00010000:3.0:1787432606.205755:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432606.205757:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fc200, rc 0) 00000100:00100000:3.0:1787432606.205835:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:11334:x1874258588384128:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 909us (5950us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787432606.205843:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 82 00000100:00100000:0.0:1787432606.212212:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432606.212392:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588384384 00000100:00100000:2.0:1787432606.212404:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588384384 00000100:00100000:2.0:1787432606.212474:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 83 00000100:00100000:2.0:1787432606.212484:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:11334:x1874258588384384:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787432606.212544:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432606.212575:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33563f169 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e1e expref: 16 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212595:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948435957a00) 00010000:00010000:2.0:1787432606.212604:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432606.212627:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f177 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212652:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f177 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212661:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f177 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212777:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f17e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x5ef3a858 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212785:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f17e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x5ef3a858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212791:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f17e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x5ef3a858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212835:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f177 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212842:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f177 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212849:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f177 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212855:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85f200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432606.212859:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f177 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212865:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f177 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212872:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:2.0:1787432606.212879:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432606.212883:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f177 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212889:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f177 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212904:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f17e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x5ef3a858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212910:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f17e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5ef3a858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212915:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f17e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5ef3a858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212920:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ee00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432606.212922:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f17e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5ef3a858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212928:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f17e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5ef3a858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212934:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x5ef3a858 (ffff948420766100) 00010000:00010000:2.0:1787432606.212936:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432606.212939:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f17e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x5ef3a858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.212944:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f17e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x5ef3a858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432606.213028:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:11334:x1874258588384384:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 538us (817us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787432606.213040:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 83 00000100:00100000:1.0:1787432606.218762:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432606.218842:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588384512 00000100:00100000:0.0:1787432606.218855:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588384512 00000100:00100000:0.0:1787432606.218922:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 84 00000100:00100000:0.0:1787432606.218934:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:11334:x1874258588384512:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432606.218957:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432606.219001:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f185 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e25 expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.219039:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f18c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.219055:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f18c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.219066:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f18c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.219264:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f185 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e25 expref: 17 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.219284:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f18c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e25 expref: 16 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.219293:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948435964300) 00010000:00010000:0.0:1787432606.219296:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787432606.219299:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948400030000, rc 0) 00000100:00100000:0.0:1787432606.219365:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:11334:x1874258588384512:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 434us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432606.219373:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 84 00000100:00100000:0.0:1787432606.221930:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432606.222120:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588384768 00000100:00100000:3.0:1787432606.222141:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588384768 00000100:00100000:3.0:1787432606.222360:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 85 00000100:00100000:3.0:1787432606.222371:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:11334:x1874258588384768:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787432606.222459:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f193 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.222477:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f193 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.222504:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f193 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787432606.222696:0:10165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1787432606.222706:0:10165:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 417314541175ns, next at 418314538815ns, rc = 0 00000004:00010000:3.0:1787432606.222760:0:10165:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb378fcc reply state 00000000ce2013f8 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f193 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.222772:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f193 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.222779:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948435964300) 00010000:00010000:3.0:1787432606.222782:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787432606.222787:0:10165:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787432606.222935:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:11334:x1874258588384768:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 564us (1014us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787432606.222943:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 85 00000100:00100000:1.0:1787432606.235251:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432606.235305:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588384896 00000100:00100000:1.0:1787432606.235316:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588384896 00000100:00100000:1.0:1787432606.235375:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 86 00000100:00100000:1.0:1787432606.235392:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:11334:x1874258588384896:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432606.235417:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432606.235446:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f19a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e2c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.235510:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f19a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e2c expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.235525:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f19a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e2c expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.235542:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948435964300) 00010000:00010000:1.0:1787432606.235545:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787432606.235549:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851400, rc 0) 00000100:00100000:1.0:1787432606.235602:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:11334:x1874258588384896:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 212us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432606.235610:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 86 00000100:00100000:2.0:1787432606.248649:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432606.248720:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588385024 00000100:00100000:1.0:1787432606.248732:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588385024 00000100:00100000:0.0:1787432606.249132:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 33 00000100:00100000:0.0:1787432606.249476:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1874258588385024:12345-192.168.204.24@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787432606.249515:0:8806:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp t0 exp 0000000000000000 cur 417 last 0 00000020:00000080:0.0:1787432606.249557:0:8806:0:(genops.c:1385:class_connect()) connect: client e37f63ac-9665-4d30-ad26-0faad6e6c7da, cookie 0xca72b3b33563f1a1 00002000:00100000:0.0:1787432606.249570:0:8806:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e37f63ac-9665-4d30-ad26-0faad6e6c7da/ffff9483025b3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787432606.249588:0:8806:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787432606.249664:0:8806:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787432606.249758:0:8806:0:(import.c:65:import_set_state_nolock()) ffff9483025b4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432606.249830:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2399:x1874258588385024:12345-192.168.204.24@tcp:8:lhsmtool_posix.0 Request processed in 688us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432606.249838:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 33 00000100:00100000:1.0:1787432606.253118:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432606.253334:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588385152 00000100:00100000:0.0:1787432606.253344:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588385152 00000100:00100000:0.0:1787432606.253402:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 34 00000100:00100000:0.0:1787432606.253413:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:0:x1874258588385152:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787432606.254118:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787432606.259961:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:3.0:1787432606.260050:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000100:00100000:0.0:1787432606.263855:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:0:x1874258588385152:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 10436us (10737us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787432606.263870:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 34 00000100:00100000:0.0:1787432606.271356:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432606.271456:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588385408 00000100:00100000:1.0:1787432606.271468:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588385408 00000100:00100000:1.0:1787432606.271533:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 19 00000100:00100000:1.0:1787432606.271545:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:11334:x1874258588385408:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787432606.271786:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:11334:x1874258588385408:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 243us (441us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1787432606.271806:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 19 00000100:00100000:2.0:1787432606.283620:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432606.283660:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588385664 00000100:00100000:2.0:1787432606.283680:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588385664 00000100:00100000:2.0:1787432606.283736:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 87 00000100:00100000:2.0:1787432606.283748:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:11334:x1874258588385664:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787432606.283868:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:11334:x1874258588385664:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 122us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432606.283876:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 87 00000100:00100000:1.0:1787432606.295724:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432606.298835:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588385792 00000100:00100000:3.0:1787432606.298852:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588385792 00000100:00100000:3.0:1787432606.298950:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 88 00000100:00100000:3.0:1787432606.298962:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:11334:x1874258588385792:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432606.298999:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432606.299023:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563f1a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e33 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.299106:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33563f1af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.299147:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33563f1af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.299179:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33563f1af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432606.299237:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787432606.299260:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33563f1af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.299288:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563f1a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e33 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.299309:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33563f1af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e33 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.299318:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948435964300) 00010000:00010000:3.0:1787432606.299321:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787432606.299324:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fc200, rc 0) 00000100:00100000:3.0:1787432606.299412:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:11334:x1874258588385792:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 452us (3704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432606.299419:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 88 00000100:00100000:3.0:1787432606.313665:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432606.314253:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588385920 00000100:00100000:0.0:1787432606.314265:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588385920 00000100:00100000:0.0:1787432606.314329:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 35 00000100:00100000:0.0:1787432606.314341:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588385920:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432606.314360:0:8806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432606.314381:0:8806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d475fef6/0xca72b3b33563f1b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e3a expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787432606.314407:0:8806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a0e9d, blocks: 0x0 00010000:00010000:0.0:1787432606.314449:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=417s v=(0 0) 00010000:00010000:0.0:1787432606.314454:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432606.314464:0:8806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d475fef6/0xca72b3b33563f1b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e3a expref: 6 pid: 8806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.314485:0:8806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d475fef6/0xca72b3b33563f1b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e3a expref: 6 pid: 8806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.314498:0:8806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948400030e00, rc 0) 00000100:00100000:0.0:1787432606.314558:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588385920:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 219us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432606.314565:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 35 00000100:00100000:2.0:1787432606.326366:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432606.326466:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588386176 00000100:00100000:0.0:1787432606.326476:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588386176 00000100:00100000:0.0:1787432606.326529:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 89 00000100:00100000:0.0:1787432606.326540:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:11334:x1874258588386176:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787432606.326667:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:11334:x1874258588386176:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 128us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432606.326682:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 89 00000100:00100000:0.0:1787432606.332415:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432606.332489:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588386304 00000100:00100000:3.0:1787432606.332498:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588386304 00000100:00100000:3.0:1787432606.332548:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 36 00000100:00100000:3.0:1787432606.332558:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:11334:x1874258588386304:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432606.332578:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432606.332610:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba14edb1/0xca72b3b33563f1bd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e41 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.332648:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d475fef6/0xca72b3b33563f1b6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e3a expref: 7 pid: 8806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.332657:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432606.332662:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432606.332667:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba14edb1/0xca72b3b33563f1bd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e41 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.332711:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d475fef6/0xca72b3b33563f1b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e3a expref: 7 pid: 8806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.332726:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d475fef6/0xca72b3b33563f1b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e3a expref: 7 pid: 8806 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432606.332741:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d26a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874258609439872:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432606.332845:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff948402ab2000 going to sleep for 11 seconds 00000100:00100000:0.0:1787432606.336221:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d26a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874258609439872:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432606.336261:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ba14edb1/0xca72b3b33563f1bd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e41 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.336286:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fce00, rc 0) 00000100:00100000:0.0:1787432606.336357:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:11334:x1874258588386304:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 3799us (3951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432606.336366:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 36 00000100:00100000:2.0:1787432606.338808:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432606.339122:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588386432 00000100:00100000:3.0:1787432606.339140:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588386432 00010000:00010000:3.0:1787432606.339204:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d475fef6/0xca72b3b33563f1b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e3a expref: 7 pid: 8806 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432606.339237:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 59 00000100:00100000:3.0:1787432606.339247:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405942300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2402:x1874258588386432:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432606.339274:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432606.339295:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d475fef6/0xca72b3b33563f1b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e3a expref: 7 pid: 8806 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.339310:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d475fef6/0xca72b3b33563f1b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e3a expref: 7 pid: 8806 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.339334:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d475fef6/0xca72b3b33563f1b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e3a expref: 7 pid: 8806 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.339353:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432606.339358:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432606.339365:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba14edb1/0xca72b3b33563f1bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e41 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.339375:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba14edb1/0xca72b3b33563f1bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e41 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.339409:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ba14edb1/0xca72b3b33563f1bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e41 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432606.339422:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6500:1874258609440000:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787432606.339507:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff948402ab2000 going to sleep for 11 seconds 00000100:00100000:1.0:1787432606.351005:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6500:1874258609440000:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787432606.351032:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432606.351091:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405942300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2402:x1874258588386432:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 11844us (12291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432606.351102:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 59 00000100:00100000:0.0:1787432606.351980:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432606.354097:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588386560 00000100:00100000:1.0:1787432606.354116:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588386560 00002000:00100000:1.0:1787432606.354208:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff94843f921500 x1874258588386560/t0(0) o4->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:317/0 lens 504/0 e 0 to 0 dl 1787432617 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787432606.354220:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94843f921500 with x1874258588386560 ext(0->8) 00002000:00010000:1.0:1787432606.354227:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94843f921500 00000100:00100000:1.0:1787432606.354267:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:1.0:1787432606.354279:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588386560:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787432606.357520:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2403:x1874258588386560:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 3231us (5543us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787432606.357542:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 0 00002000:00100000:2.0:1787432606.357556:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff94843f921500 x1874258588386560/t4294967303(0) o4->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:317/0 lens 504/448 e 0 to 0 dl 1787432617 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787432606.357566:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94843f921500 with x1874258588386560 ext(0->8) 00002000:00010000:2.0:1787432606.357572:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94843f921500 00000100:00100000:1.0:1787432606.361255:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432606.361342:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588386688 00000100:00100000:2.0:1787432606.361351:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588386688 00000100:00100000:2.0:1787432606.361404:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 90 00000100:00100000:2.0:1787432606.361413:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:11334:x1874258588386688:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787432606.363754:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1787432606.363773:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787432606.363807:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:1.0:1787432606.364271:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609440128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787432606.364353:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432606.364455:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609440128 00000100:00100000:3.0:1787432606.364462:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609440128 00000100:00100000:3.0:1787432606.364527:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787432606.364551:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609440128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787432606.364703:0:8806:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787432606.364707:0:8806:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787432606 00002000:00010000:3.0:1787432606.364709:0:8806:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787432606.364711:0:8806:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787432605 -> 1787432606 00002000:00010000:3.0:1787432606.364713:0:8806:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1787432606.364757:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1874258609440128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 207us (402us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787432606.364764:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787432606.364914:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787432606.364956:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff948409d25500/2, rc 0, transno 4294967304 00000100:00100000:1.0:1787432606.364963:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609440128:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1787432606.365176:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1787432606.365191:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:2.0:1787432606.366464:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f193 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.366485:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f193 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.366492:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f193 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.366498:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fdc00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432606.366504:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f193 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.366511:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f193 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.366528:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948435964300) 00010000:00010000:2.0:1787432606.366531:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787432606.366535:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f193 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.366541:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563f193 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432606.367410:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:11334:x1874258588386688:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 5990us (6155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432606.367422:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 90 00000100:00100000:1.0:1787432606.379491:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432606.379582:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588386816 00000100:00100000:0.0:1787432606.379597:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588386816 00000100:00100000:0.0:1787432606.379676:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 38 00000100:00100000:0.0:1787432606.379687:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2402:x1874258588386816:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787432606.381399:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1787432606.381413:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1787432606.381576:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2402:x1874258588386816:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 1885us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432606.381587:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 38 00000100:00100000:3.0:1787432606.384509:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432606.384592:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588387072 00000100:00100000:1.0:1787432606.384603:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588387072 00000100:00100000:1.0:1787432606.384661:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 91 00000100:00100000:1.0:1787432606.384685:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:11334:x1874258588387072:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787432606.384742:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432606.384773:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33563f1af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e33 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.384797:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948435964300) 00010000:00010000:1.0:1787432606.384803:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432606.384834:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f1c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.384847:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.384856:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787432606.385409:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007850b15f reply state 0000000014b876b5 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.385424:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f1c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.385442:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948435964300) 00010000:00010000:1.0:1787432606.385461:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787432606.385464:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787432606.385608:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:11334:x1874258588387072:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 935us (1107us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1787432606.385617:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 91 00000100:00100000:0.0:1787432606.395531:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432606.395610:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588387200 00000100:00100000:3.0:1787432606.395620:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588387200 00000100:00100000:3.0:1787432606.395687:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 39 00000100:00100000:3.0:1787432606.395699:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2402:x1874258588387200:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787432606.395871:0:8806:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787432606.395875:0:8806:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787432606 -> 1787432604 00002000:00010000:3.0:1787432606.395878:0:8806:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787432603 00002000:00010000:3.0:1787432606.395880:0:8806:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787432606 -> 1787432604 00002000:00010000:3.0:1787432606.395882:0:8806:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787432606.395952:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2402:x1874258588387200:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 255us (430us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787432606.395960:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 39 00000100:00100000:0.0:1787432606.398725:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432606.398840:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588387456 00000100:00100000:3.0:1787432606.398850:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588387456 00000100:00100000:3.0:1787432606.398905:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 92 00000100:00100000:3.0:1787432606.398914:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:11334:x1874258588387456:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787432606.399011:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.399028:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f18c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e25 expref: 15 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.399038:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1cb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.399072:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f18c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e25 expref: 15 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.399086:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f18c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e25 expref: 15 pid: 9020 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432606.399100:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874258609440256:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432606.399215:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303015180 going to sleep for 11 seconds 00000100:00100000:0.0:1787432606.401946:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432606.401984:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588387584 00000100:00100000:0.0:1787432606.401991:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588387584 00010000:00010000:0.0:1787432606.402031:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f18c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e25 expref: 16 pid: 9020 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432606.402067:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 60 00000100:00100000:0.0:1787432606.402077:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:2403:x1874258588387584:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432606.402091:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432606.402099:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f18c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e25 expref: 16 pid: 9020 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.402142:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f18c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e25 expref: 16 pid: 9020 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.402190:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948435964300) 00010000:00010000:0.0:1787432606.402195:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.402206:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.402214:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1cb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.402233:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432606.402281:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:2403:x1874258588387584:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 205us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432606.402289:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 60 00010000:00010000:3.0:1787432606.403045:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f18c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e25 expref: 15 pid: 9020 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432606.403067:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874258609440256:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432606.403089:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.403098:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.403104:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.403190:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.403198:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1cb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.403204:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.403211:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303012400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432606.403216:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.403223:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1cb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.403234:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948435964300) 00010000:00010000:3.0:1787432606.403238:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787432606.403242:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1cb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.403248:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1cb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432606.403311:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:11334:x1874258588387456:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 4396us (4594us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787432606.403320:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 92 00000100:00100000:0.0:1787432606.417395:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432606.417507:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588387712 00000100:00100000:1.0:1787432606.417519:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588387712 00000100:00100000:1.0:1787432606.417592:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 40 00000100:00100000:1.0:1787432606.417605:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2402:x1874258588387712:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787432606.417655:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563f1d2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.417688:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba14edb1/0xca72b3b33563f1bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e41 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.417697:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432606.417702:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787432606.417707:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563f1d2 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.417747:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba14edb1/0xca72b3b33563f1bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e41 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.417763:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba14edb1/0xca72b3b33563f1bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e41 expref: 7 pid: 8430 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432606.417776:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405503800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874258609440384:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432606.417860:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830380d240 going to sleep for 11 seconds 00000100:00100000:1.0:1787432606.423332:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432606.423417:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405503800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874258609440384:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432606.423461:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563f1d2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432606.423580:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588387840 00000100:00100000:2.0:1787432606.423587:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588387840 00010000:00010000:2.0:1787432606.423621:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba14edb1/0xca72b3b33563f1bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e41 expref: 8 pid: 8430 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432606.423659:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 61 00000100:00100000:2.0:1787432606.423682:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405501c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2402:x1874258588387840:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432606.423697:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432606.423718:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba14edb1/0xca72b3b33563f1bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e41 expref: 8 pid: 8430 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.423730:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba14edb1/0xca72b3b33563f1bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e41 expref: 8 pid: 8430 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.423753:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba14edb1/0xca72b3b33563f1bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e41 expref: 8 pid: 8430 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.423769:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432606.423773:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432606.423779:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563f1d2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.423789:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563f1d2 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.423815:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432606.423881:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563f1d2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.423889:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563f1d2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.423908:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563f1d2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.423917:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563f1d2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.423925:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563f1d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.423932:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851e00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432606.423936:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563f1d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.423944:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563f1d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.423955:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563f1d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.423973:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563f1d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432606.424350:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405501c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2402:x1874258588387840:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 665us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432606.424358:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 61 00000100:00100000:3.0:1787432606.424439:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2402:x1874258588387712:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 6827us (7046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432606.424448:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 40 00000100:00100000:0.0:1787432606.427570:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432606.427658:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588388096 00000100:00100000:2.0:1787432606.427730:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588388096 00000100:00100000:2.0:1787432606.427821:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 93 00000100:00100000:2.0:1787432606.427831:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:11334:x1874258588388096:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787432606.427938:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f1d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.427956:0:10165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f019 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dca expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.427966:0:10165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f1d9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.428005:0:10165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dca expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.428020:0:10165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f019 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dca expref: 14 pid: 6515 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432606.428035:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405940380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609440512:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432606.430151:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff948406cb5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432606.431844:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432606.431909:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588388224 00000100:00100000:0.0:1787432606.431920:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588388224 00010000:00010000:0.0:1787432606.431967:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f019 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dca expref: 15 pid: 6515 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432606.432014:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 62 00000100:00100000:0.0:1787432606.432035:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94841223e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:2402:x1874258588388224:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432606.432049:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432606.432066:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f019 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dca expref: 15 pid: 6515 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.432079:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f019 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dca expref: 15 pid: 6515 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.432104:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:0.0:1787432606.432110:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f1d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.432120:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f1d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.432140:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f1d9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.432161:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432606.432245:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94841223e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:2402:x1874258588388224:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 221us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432606.432253:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 62 00010000:00010000:3.0:1787432606.433779:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f019 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4dca expref: 14 pid: 6515 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432606.433802:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405940380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609440512:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432606.433825:0:10165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f1d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.433835:0:10165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f1d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.433841:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f1d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.434348:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1e0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.434363:0:10165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f19a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e2c expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.434371:0:10165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1e0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.434424:0:10165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f19a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e2c expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.434452:0:10165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f19a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e2c expref: 14 pid: 6513 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432606.434467:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609440640:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432606.434595:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787432606.438245:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432606.438335:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588388352 00000100:00100000:2.0:1787432606.438347:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588388352 00010000:00010000:2.0:1787432606.438400:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f19a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e2c expref: 15 pid: 6513 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432606.438445:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 63 00000100:00100000:2.0:1787432606.438458:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405501c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:2403:x1874258588388352:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432606.438474:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432606.438480:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f19a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e2c expref: 15 pid: 6513 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.438513:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f19a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e2c expref: 15 pid: 6513 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.438540:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948435964300) 00010000:00010000:2.0:1787432606.438545:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1e0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.438555:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.438563:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1e0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.438583:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432606.438652:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405501c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:2403:x1874258588388352:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 196us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432606.438659:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 63 00010000:00010000:3.0:1787432606.439159:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f19a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e2c expref: 14 pid: 6513 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432606.439203:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609440640:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432606.439224:0:10165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.439234:0:10165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.439240:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787432606.439392:0:10165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1787432606.439528:0:10165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1787432606.439565:0:10165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1787432606.439656:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10165:1874258609440768:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787432606.439714:0:10165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432606.439746:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432606.439846:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609440768 00000100:00100000:2.0:1787432606.439852:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609440768 00000100:00100000:2.0:1787432606.439901:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787432606.439911:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10165:x1874258609440768:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787432606.440018:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10165:x1874258609440768:12345-0@lo:1000:mdt00_004.0 Request processed in 109us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432606.440025:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787432606.440400:0:10165:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787432606.440408:0:10165:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff948409d25500, transno 4294967304 00000100:00100000:1.0:1787432606.440424:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10165:1874258609440768:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1787432606.440549:0:10165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1787432606.440604:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405503800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10165:1874258609440896:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787432606.440643:0:10165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432606.440671:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830380df00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432606.440782:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609440896 00000100:00100000:0.0:1787432606.440787:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609440896 00000100:00100000:0.0:1787432606.440825:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787432606.440834:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10165:x1874258609440896:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787432606.440935:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10165:x1874258609440896:12345-0@lo:1000:mdt00_004.0 Request processed in 103us (292us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787432606.440943:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787432606.441883:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405503800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10165:1874258609440896:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1787432606.441928:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.441938:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1e0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.441946:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1e0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.441952:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303012400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432606.441956:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1e0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.441964:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1e0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.441980:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948435964300) 00010000:00010000:1.0:1787432606.441997:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787432606.442003:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1e0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.442010:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f1e0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.442052:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f115 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.442059:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f115 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.442065:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f115 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.442070:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432606.442073:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f115 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.442079:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f115 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.442088:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:1.0:1787432606.442090:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787432606.442094:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f115 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.442100:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f115 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.442139:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f1e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.442194:0:10165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f131 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e10 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.442204:0:10165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f1e7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.442239:0:10165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f131 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e10 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.442253:0:10165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f131 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e10 expref: 17 pid: 6514 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432606.442267:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609441024:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432606.442345:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830380df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432606.447925:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432606.448031:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588388480 00000100:00100000:0.0:1787432606.448041:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588388480 00010000:00010000:0.0:1787432606.448095:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f131 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e10 expref: 18 pid: 6514 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432606.448144:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 64 00000100:00100000:0.0:1787432606.448154:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:2402:x1874258588388480:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432606.448203:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432606.448211:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f131 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e10 expref: 18 pid: 6514 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.448224:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f131 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e10 expref: 18 pid: 6514 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.448248:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:0.0:1787432606.448254:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f1e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.448266:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f1e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.448275:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f1e7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.448294:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432606.448355:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:2402:x1874258588388480:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 203us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432606.448362:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 64 00010000:00010000:2.0:1787432606.448990:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f131 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e10 expref: 17 pid: 6514 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432606.449032:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609441024:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432606.449059:0:10165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f1e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.449068:0:10165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f1e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.449074:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f1e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.449086:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f1e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.449093:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f1e7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.449101:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f1e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.449107:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432606.449111:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f1e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.449118:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f1e7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.449140:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:2.0:1787432606.449143:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432606.449146:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f1e7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.449159:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f1e7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.449213:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f1d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.449219:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f1d9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.449224:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f1d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.449229:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fe00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432606.449232:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f1d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.449237:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f1d9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.449245:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9483032adb00) 00010000:00010000:2.0:1787432606.449247:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787432606.449249:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f1d9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.449254:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f1d9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432606.449441:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:11334:x1874258588388096:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 21598us (21869us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787432606.449451:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 93 00000020:00080000:2.0:1787432606.449462:0:10165:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787432606.449632:0:13810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787432606.449638:0:13810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787432606.449654:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787432606.449661:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787432606.453642:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432606.453857:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588388736 00000100:00100000:0.0:1787432606.453869:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588388736 00000100:00100000:0.0:1787432606.453940:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00100000:0.0:1787432606.453997:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:11334:x1874258588388736:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787432606.454525:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787432606.454561:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1787432606.454600:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f1ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.454619:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f1ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.454632:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f1ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.454641:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f1ee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.454647:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f1ee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.454653:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f1ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.454839:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787432606.454938:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:11334:x1874258588388736:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 955us (1304us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787432606.454946:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 20 00000020:00080000:0.0:1787432606.454953:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787432606.461893:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432606.461910:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f1ee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.461922:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432606.461927:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f1ee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.461937:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f1ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.461958:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948435964300) 00010000:00010000:1.0:1787432606.461991:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787432606.461997:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f1ee lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.462003:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f1ee lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.467724:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432606.467733:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432606.467736:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432606.669082:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483038c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609441152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432606.669183:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432606.669247:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432606.669254:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609441280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432606.669282:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432606.669313:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609441152 00000100:00100000:3.0:1787432606.669316:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432606.669319:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609441152 00000100:00100000:3.0:1787432606.669325:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609441408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432606.669353:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432606.669369:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609441408 00000100:00100000:0.0:1787432606.669372:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609441408 00000100:00100000:3.0:1787432606.669385:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787432606.669396:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609441152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787432606.669442:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432606.669494:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609441152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432606.669555:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483038c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609441152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432606.669976:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787432606.669996:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1874258609441408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432606.670008:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432606.670050:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1874258609441408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432606.670056:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787432606.670087:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609441280 00000100:00100000:0.0:1787432606.670091:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609441280 00000100:00100000:0.0:1787432606.670119:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787432606.670125:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609441280:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432606.670594:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000004:00000024:0.0:1787432606.670911:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1787432606.670976:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609441280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 850us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432606.670991:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1787432606.671009:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432606.671134:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609441408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432606.672303:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609441280:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787432606.682478:0:14221:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787432606.682489:0:14221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787432606.682525:0:14221:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787432606.682532:0:14221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787432606.830860:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432606.830955:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588388992 00000100:00100000:2.0:1787432606.830964:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588388992 00000100:00100000:2.0:1787432606.831050:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 94 00000100:00100000:2.0:1787432606.831061:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:11344:x1874258588388992:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432606.831090:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432606.831110:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f1f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e48 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.831256:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f1fc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.831270:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f1fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.831281:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f1fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432606.831292:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787432606.831392:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f1f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e48 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.831419:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f1fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e48 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.831437:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:2.0:1787432606.831440:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787432606.831443:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e800, rc 0) 00000100:00100000:2.0:1787432606.831503:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:11344:x1874258588388992:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 444us (654us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787432606.831526:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 94 00000100:00100000:0.0:1787432606.843470:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432606.846546:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588389120 00000100:00100000:3.0:1787432606.846566:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588389120 00000100:00100000:3.0:1787432606.846646:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 95 00000100:00100000:3.0:1787432606.846657:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:11344:x1874258588389120:12345-192.168.204.24@tcp:34:lfs.0 00010000:00010000:3.0:1787432606.846738:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f20a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.846755:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f20a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.846765:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f20a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.846793:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f211 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.846800:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.846807:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.846884:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f218 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.846892:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f218 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.846898:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f218 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432606.846950:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f218 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.846963:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f20a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.846969:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f20a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.846977:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f20a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.846983:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303012000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432606.846987:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f20a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.847001:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f20a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.847015:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:3.0:1787432606.847018:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432606.847024:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f20a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.847031:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f20a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.847044:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f211 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.847050:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f211 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.847057:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f211 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.847062:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432606.847065:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f211 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.847070:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f211 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.847076:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948435957f00) 00010000:00010000:3.0:1787432606.847079:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432606.847081:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f211 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.847097:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f211 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.847112:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f218 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.847134:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f218 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.847140:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f218 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.847145:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432606.847149:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f218 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.847155:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f218 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.847187:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948435957800) 00010000:00010000:3.0:1787432606.847190:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432606.847193:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f218 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.847199:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f218 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432606.847303:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:11344:x1874258588389120:12345-192.168.204.24@tcp:34:lfs.0 Request processed in 646us (3838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432606.847312:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 95 00000100:00100000:2.0:1787432606.905157:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432606.905376:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588389376 00000100:00100000:3.0:1787432606.905387:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588389376 00000100:00100000:3.0:1787432606.905439:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 96 00000100:00100000:3.0:1787432606.905449:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:11347:x1874258588389376:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432606.905470:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432606.905490:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f21f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e4f expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905558:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f226 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905572:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f226 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905583:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f226 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905605:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f22d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905613:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f22d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905619:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f22d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905726:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563f234 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905734:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563f234 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905758:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563f234 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432606.905769:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787432606.905841:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f226 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905848:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f226 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905854:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f226 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905859:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432606.905864:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f226 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905870:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f226 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905882:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:3.0:1787432606.905885:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432606.905889:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f226 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905895:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f226 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905906:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f22d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905912:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f22d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905925:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f22d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905930:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303012000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432606.905933:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f22d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905939:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f22d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905948:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948435957800) 00010000:00010000:3.0:1787432606.905951:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432606.905954:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f22d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.905971:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f22d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.906010:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f21f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e4f expref: 23 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.906022:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563f234 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e4f expref: 22 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.906030:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948435957f00) 00010000:00010000:3.0:1787432606.906032:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432606.906034:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303012200, rc 0) 00000100:00100000:3.0:1787432606.906417:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:11347:x1874258588389376:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 967us (1270us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787432606.906442:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 96 00000100:00100000:3.0:1787432606.908508:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432606.908612:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588389504 00000100:00100000:2.0:1787432606.908622:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588389504 00000100:00100000:2.0:1787432606.908679:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 97 00000100:00100000:2.0:1787432606.908690:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:11347:x1874258588389504:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:2.0:1787432606.908748:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f242 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.908763:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.908773:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.908805:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.908812:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f242 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.908818:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.908824:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ea00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432606.908828:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.908834:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f242 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.908860:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948435957f00) 00010000:00010000:2.0:1787432606.908862:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787432606.908866:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f242 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.908872:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f242 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432606.908938:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:11347:x1874258588389504:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 249us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432606.908945:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 97 00000100:00100000:1.0:1787432606.913381:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432606.915589:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588389760 00000100:00100000:2.0:1787432606.915762:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588389760 00000100:00100000:2.0:1787432606.915826:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:2.0:1787432606.915838:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948411a1f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:11347:x1874258588389760:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:3.0:1787432606.916760:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948411a1f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:11347:x1874258588389760:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 919us (3382us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1787432606.916771:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 21 00010000:00010000:3.0:1787432606.924353:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432606.959825:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432606.959902:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588390016 00000100:00100000:3.0:1787432606.959916:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588390016 00000100:00100000:3.0:1787432606.959980:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 98 00000100:00100000:3.0:1787432606.959992:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:10873:x1874258588390016:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787432606.960017:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432606.960038:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f249 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e56 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.960207:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f250 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.960224:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563f234 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e4f expref: 24 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.960234:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f250 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.960273:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563f234 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e4f expref: 24 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.960290:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563f234 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e4f expref: 24 pid: 10165 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432606.960322:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304434e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874258609441536:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432606.960430:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432606.965966:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432606.966067:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588390144 00000100:00100000:1.0:1787432606.966077:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588390144 00010000:00010000:1.0:1787432606.966124:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563f234 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e4f expref: 25 pid: 10165 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432606.966216:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 65 00000100:00100000:1.0:1787432606.966231:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+25:2403:x1874258588390144:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432606.966250:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432606.966259:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563f234 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e4f expref: 25 pid: 10165 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.966273:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563f234 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e4f expref: 25 pid: 10165 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.966322:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948435957f00) 00010000:00010000:1.0:1787432606.966327:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f250 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.966338:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f250 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.966346:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f250 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.966366:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432606.966417:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+25:2403:x1874258588390144:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 188us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432606.966435:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 65 00010000:00010000:2.0:1787432606.966613:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012200/0xca72b3b33563f234 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e4f expref: 24 pid: 10165 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432606.966632:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304434e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874258609441536:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432606.966657:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f250 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.966666:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f250 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.966672:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f250 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432606.966703:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787432606.966837:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f249 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e56 expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.966852:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f250 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e56 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.966860:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948435957f00) 00010000:00010000:2.0:1787432606.966862:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787432606.966865:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303013c00, rc 0) 00000100:00100000:2.0:1787432606.966891:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+24:10873:x1874258588390016:12345-192.168.204.24@tcp:101:bash.0 Request processed in 6902us (7077us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1787432606.966897:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 98 00000100:00100000:1.0:1787432606.970961:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432606.971052:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588390272 00000100:00100000:2.0:1787432606.971063:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588390272 00000100:00100000:2.0:1787432606.971128:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 99 00000100:00100000:2.0:1787432606.971139:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+24:10873:x1874258588390272:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787432606.971226:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432606.971255:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f25e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e5d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.971306:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f265 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.971322:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f265 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.971346:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f265 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.971481:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f25e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e5d expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.971509:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f265 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e5d expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.971518:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948435957f00) 00010000:00010000:2.0:1787432606.971521:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787432606.971525:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85fe00, rc 0) 00000100:00100000:2.0:1787432606.971874:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+25:10873:x1874258588390272:12345-192.168.204.24@tcp:101:bash.0 Request processed in 455us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432606.971881:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 99 00000100:00100000:3.0:1787432606.976226:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432606.976787:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588390528 00000100:00100000:0.0:1787432606.976798:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588390528 00000100:00100000:0.0:1787432606.976911:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 100 00000100:00100000:0.0:1787432606.976924:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+25:10873:x1874258588390528:12345-192.168.204.24@tcp:36:bash.0 00010000:00010000:0.0:1787432606.977246:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f26c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.977264:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f26c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.977277:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f26c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787432606.977335:0:9020:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1787432606.977362:0:9020:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a0764c4 reply state 00000000a8286e49 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f26c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.977376:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f26c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.977384:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948435957f00) 00010000:00010000:0.0:1787432606.977387:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787432606.977392:0:9020:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787432606.977450:0:9020:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1787432606.977573:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+29:10873:x1874258588390528:12345-192.168.204.24@tcp:36:bash.0 Request processed in 651us (1407us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1787432606.977581:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 100 00000020:00080000:0.0:1787432606.977586:0:9020:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787432606.982970:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432606.983083:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588390656 00000100:00100000:2.0:1787432606.983092:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588390656 00000100:00100000:2.0:1787432606.983336:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 101 00000100:00100000:2.0:1787432606.983349:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+29:10873:x1874258588390656:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787432606.983374:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432606.983395:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f273 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e64 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.983471:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f273 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e64 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.983487:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f273 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e64 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432606.983525:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948435957f00) 00010000:00010000:2.0:1787432606.983528:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787432606.983531:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e600, rc 0) 00000100:00100000:2.0:1787432606.983603:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:10873:x1874258588390656:12345-192.168.204.24@tcp:101:bash.0 Request processed in 249us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432606.983610:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 101 00000100:00100000:1.0:1787432606.987643:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432606.987852:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588390784 00000100:00100000:0.0:1787432606.987865:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588390784 00000100:00100000:0.0:1787432606.987923:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 41 00000100:00100000:0.0:1787432606.987934:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:10873:x1874258588390784:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787432606.987959:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432606.987984:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c456bbf/0xca72b3b33563f27a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e6b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787432606.988025:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8a0e9c, atime: 0x6a8a0e9b, ctime: 0x6a8a0e9c, blocks: 0x8 00010000:00010000:0.0:1787432606.988048:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=418s v=(0 0) 00010000:00010000:0.0:1787432606.988053:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432606.988063:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c456bbf/0xca72b3b33563f27a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e6b expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.988083:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c456bbf/0xca72b3b33563f27a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e6b expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.988095:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948400030c00, rc 0) 00000100:00100000:0.0:1787432606.988242:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:10873:x1874258588390784:12345-192.168.204.24@tcp:101:bash.0 Request processed in 309us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432606.988250:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 41 00000100:00100000:3.0:1787432606.992147:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432606.994559:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588390912 00000100:00100000:2.0:1787432606.994581:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588390912 00002000:00010000:0.0:1787432606.994771:0:8435:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1787432606.994777:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948405566a00 with x1874258588390912 ext(0->18446744073709551615) 00002000:00010000:0.0:1787432606.994790:0:8435:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948405566a00. 00000100:00100000:0.0:1787432606.994844:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1 00000100:00100000:0.0:1787432606.994853:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2403:x1874258588390912:12345-192.168.204.24@tcp:10:bash.0 00002000:00010000:0.0:1787432606.995148:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787432606.995152:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787432604 -> 1787432606 00002000:00010000:0.0:1787432606.995155:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1787432603 -> 1787432603 00002000:00010000:0.0:1787432606.995156:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787432604 -> 1787432606 00002000:00010000:0.0:1787432606.995158:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1787432606.995608:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2403:x1874258588390912:12345-192.168.204.24@tcp:10:bash.0 Request processed in 753us (3470us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787432606.995616:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1 00002000:00010000:0.0:1787432606.995620:0:8435:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1787432606.995623:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948405566a00 with x1874258588390912 ext(0->18446744073709551615) 00002000:00010000:0.0:1787432606.995629:0:8435:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948405566a00. 00000100:00100000:3.0:1787432607.112579:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432607.112815:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588391040 00000100:00100000:2.0:1787432607.112827:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588391040 00000100:00100000:2.0:1787432607.112897:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 102 00000100:00100000:2.0:1787432607.112907:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:11361:x1874258588391040:12345-192.168.204.24@tcp:34:lfs.0 00010000:00010000:2.0:1787432607.113002:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f281 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113022:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f281 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113034:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f281 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113051:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f288 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113058:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f288 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113064:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f288 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113157:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f28f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113192:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f28f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113199:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f28f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432607.113250:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f28f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113262:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f281 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113268:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f281 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113275:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f281 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113282:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ea00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432607.113286:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f281 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113293:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f281 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113304:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:2.0:1787432607.113307:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432607.113312:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f281 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113325:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f281 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113362:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f288 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113369:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f288 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113881:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f288 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113887:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fa00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432607.113890:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f288 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113897:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f288 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113907:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948420766100) 00010000:00010000:2.0:1787432607.113910:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432607.113913:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f288 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113919:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f288 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113938:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f28f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113944:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f28f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113958:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f28f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113963:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85f800 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432607.113966:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f28f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.113972:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f28f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.115146:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948435957f00) 00010000:00010000:2.0:1787432607.115155:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432607.115175:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f28f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.115186:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f28f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432607.117718:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:11361:x1874258588391040:12345-192.168.204.24@tcp:34:lfs.0 Request processed in 2424us (2763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432607.117744:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 102 00000100:00100000:0.0:1787432607.179759:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432607.179788:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609441664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432607.179891:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432607.180004:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609441664 00000100:00100000:0.0:1787432607.180013:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609441664 00000100:00100000:0.0:1787432607.180061:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787432607.180070:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609441664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787432607.180096:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1787432607.180144:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609441664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.180151:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787432607.180229:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609441664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432607.182963:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609441792:0@lo:400:kworker.0 00000100:00100000:1.0:1787432607.183051:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432607.183094:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609442304:0@lo:400:kworker.0 00000100:00100000:1.0:1787432607.183122:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432607.183141:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609442816:0@lo:400:kworker.0 00000100:00100000:1.0:1787432607.183190:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432607.183217:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787432607.183224:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609441920:0@lo:400:kworker.0 00000100:00100000:1.0:1787432607.183254:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432607.183282:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609442432:0@lo:400:kworker.0 00000100:00100000:1.0:1787432607.183307:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432607.183323:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830443d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609442944:0@lo:400:kworker.0 00000100:00100000:1.0:1787432607.183343:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432607.183377:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609441792 00000100:00100000:1.0:1787432607.183386:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609441792 00000100:00100000:1.0:1787432607.183454:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787432607.183464:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609441792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432607.183516:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609441792:12345-0@lo:400:kworker.0 Request processed in 54us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432607.183523:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787432607.183558:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609442304 00000100:00100000:1.0:1787432607.183562:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609442304 00000100:00100000:1.0:1787432607.183585:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787432607.183592:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609442304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432607.183626:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609442304:12345-0@lo:400:kworker.0 Request processed in 35us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432607.183632:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787432607.183663:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609441792:0@lo:400:kworker.0 00000100:00100000:1.0:1787432607.183677:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609442304:0@lo:400:kworker.0 00000100:00100000:1.0:1787432607.183704:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609441920 00000100:00100000:1.0:1787432607.183708:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609441920 00000100:00100000:1.0:1787432607.183732:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609442432 00000100:00100000:1.0:1787432607.183735:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609442432 00000100:00100000:1.0:1787432607.183760:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609442944 00000100:00100000:1.0:1787432607.183763:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609442944 00000100:00100000:1.0:1787432607.183779:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1787432607.183795:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609441920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432607.183831:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609441920:12345-0@lo:400:kworker.0 Request processed in 38us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432607.183837:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1787432607.183849:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787432607.183856:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609442432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432607.183883:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609442432:12345-0@lo:400:kworker.0 Request processed in 29us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432607.183889:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787432607.183899:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787432607.183906:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609442944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432607.183931:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609442944:12345-0@lo:400:kworker.0 Request processed in 27us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432607.183937:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787432607.183961:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609441920:0@lo:400:kworker.0 00000100:00100000:1.0:1787432607.183970:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609442432:0@lo:400:kworker.0 00000100:00100000:1.0:1787432607.183978:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830443d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609442944:0@lo:400:kworker.0 00000100:00100000:0.0:1787432607.184108:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609442816 00000100:00100000:0.0:1787432607.184113:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609442816 00000100:00100000:0.0:1787432607.184151:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787432607.184159:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3643:x1874258609442816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432607.184236:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3643:x1874258609442816:12345-0@lo:400:kworker.0 Request processed in 78us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.184243:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1787432607.184266:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787432607.184278:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432607.184293:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609442048:0@lo:400:kworker.0 00000100:00100000:0.0:1787432607.184329:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432607.184353:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609442560:0@lo:400:kworker.0 00000100:00100000:0.0:1787432607.184374:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432607.184389:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830443c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609443072:0@lo:400:kworker.0 00000100:00100000:0.0:1787432607.184407:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432607.184433:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787432607.184438:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609442176:0@lo:400:kworker.0 00000100:00100000:0.0:1787432607.184467:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432607.184480:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609442688:0@lo:400:kworker.0 00000100:00100000:0.0:1787432607.184498:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432607.184511:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830443fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609443200:0@lo:400:kworker.0 00000100:00100000:0.0:1787432607.184525:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432607.184545:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609442048 00000100:00100000:0.0:1787432607.184548:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609442048 00000100:00100000:0.0:1787432607.184568:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787432607.184574:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609442048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432607.184612:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609442048:12345-0@lo:400:kworker.0 Request processed in 37us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.184618:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787432607.184633:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609442688 00000100:00100000:0.0:1787432607.184636:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609442688 00000100:00100000:0.0:1787432607.184654:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609443200 00000100:00100000:0.0:1787432607.184656:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609443200 00000100:00100000:0.0:1787432607.184675:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787432607.184681:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609442688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432607.184719:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609442688:12345-0@lo:400:kworker.0 Request processed in 39us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.184726:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787432607.184737:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787432607.184742:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609443200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432607.184769:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609443200:12345-0@lo:400:kworker.0 Request processed in 27us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.184774:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1787432607.184787:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432607.184818:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609442816:0@lo:400:kworker.0 00000100:00100000:0.0:1787432607.184844:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609442688:0@lo:400:kworker.0 00000100:00100000:0.0:1787432607.184853:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830443fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609443200:0@lo:400:kworker.0 00000100:00100000:0.0:1787432607.184862:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609442048:0@lo:400:kworker.0 00000100:00100000:0.0:1787432607.184880:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609442560 00000100:00100000:0.0:1787432607.184884:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609442560 00000100:00100000:0.0:1787432607.184908:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609443072 00000100:00100000:0.0:1787432607.184911:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609443072 00000100:00100000:0.0:1787432607.184920:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609442176 00000100:00100000:0.0:1787432607.184922:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609442176 00000100:00100000:0.0:1787432607.184933:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787432607.184939:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609442560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432607.184974:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609442560:12345-0@lo:400:kworker.0 Request processed in 35us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.184980:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787432607.184990:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1787432607.185003:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609443072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432607.185031:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609443072:12345-0@lo:400:kworker.0 Request processed in 30us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.185037:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1787432607.185050:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1787432607.185056:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609442176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432607.185081:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609442176:12345-0@lo:400:kworker.0 Request processed in 26us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.185087:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00080000:0.0:1787432607.185100:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787432607.185116:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609442176:0@lo:400:kworker.0 00010000:00080000:0.0:1787432607.185129:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483039b6d80 x1874258609442560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432607.185139:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609442560:0@lo:400:kworker.0 00010000:00080000:0.0:1787432607.185148:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830443c380 x1874258609443072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432607.185155:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830443c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609443072:0@lo:400:kworker.0 00000100:00100000:2.0:1787432607.186012:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432607.186029:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609443328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432607.186078:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432607.186131:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609443328 00000100:00100000:2.0:1787432607.186136:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609443328 00000100:00100000:2.0:1787432607.186193:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787432607.186201:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609443328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787432607.186221:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1787432607.186277:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609443328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432607.186284:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787432607.186324:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609443328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432607.190472:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432607.190740:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588391296 00000100:00100000:0.0:1787432607.190751:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588391296 00000100:00100000:0.0:1787432607.190800:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 103 00000100:00100000:0.0:1787432607.190810:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:11364:x1874258588391296:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787432607.190830:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432607.190850:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f296 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e72 expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.191391:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f29d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.191408:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f29d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.191428:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f29d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.191445:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.191452:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.191458:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.192294:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563f2ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.192308:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563f2ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.192317:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563f2ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432607.192329:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787432607.192423:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f29d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.192431:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f29d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.192451:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f29d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.192457:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432607.192462:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f29d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.192471:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f29d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.192484:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:0.0:1787432607.192487:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432607.192491:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f29d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.192497:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f29d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.192511:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.192517:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.192521:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.192526:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94840149f000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432607.192528:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.192543:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.192550:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948435964d00) 00010000:00010000:0.0:1787432607.192552:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432607.192555:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.192559:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.193787:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f296 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e72 expref: 33 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.193811:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563f2ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e72 expref: 32 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.193820:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948435957f00) 00010000:00010000:0.0:1787432607.193822:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787432607.193825:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94840149ec00, rc 0) 00000100:00100000:0.0:1787432607.194084:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+32:11364:x1874258588391296:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3271us (3619us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787432607.194095:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 103 00000100:00100000:3.0:1787432607.197213:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432607.197402:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588391424 00000100:00100000:1.0:1787432607.197422:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588391424 00000100:00100000:1.0:1787432607.197493:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 104 00000100:00100000:1.0:1787432607.197503:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+32:11364:x1874258588391424:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:1.0:1787432607.197575:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f2b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.197592:0:10165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f250 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e56 expref: 32 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.197618:0:10165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f2b9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.197667:0:10165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f250 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e56 expref: 32 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.197682:0:10165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f250 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e56 expref: 32 pid: 6514 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432607.197698:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830443d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609443456:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432607.197804:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830380d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432607.201443:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432607.201527:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588391680 00000100:00100000:0.0:1787432607.201538:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588391680 00000100:00100000:0.0:1787432607.201606:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:0.0:1787432607.201618:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+33:6171:x1874258588391680:12345-192.168.204.24@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787432607.201733:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830443d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609443456:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432607.201763:0:10165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f2b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432607.202212:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+34:6171:x1874258588391680:12345-192.168.204.24@tcp:35:ldlm_bl.0 Request processed in 594us (779us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1787432607.202221:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:3.0:1787432607.207774:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432607.207897:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588391808 00000100:00100000:0.0:1787432607.207907:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588391808 00010000:00010000:0.0:1787432607.207948:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f250 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e56 expref: 34 pid: 6514 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432607.208049:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 66 00000100:00100000:0.0:1787432607.208061:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+34:2402:x1874258588391808:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432607.208086:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432607.208094:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f250 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e56 expref: 34 pid: 6514 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.208119:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f250 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e56 expref: 34 pid: 6514 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.208145:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f250 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e56 expref: 34 pid: 6514 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.208219:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948435957f00) 00010000:00010000:0.0:1787432607.208225:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f2b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.208238:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.208246:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f2b9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.208297:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432607.208356:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+33:2402:x1874258588391808:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 298us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.208364:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 66 00010000:00010000:3.0:1787432607.208725:0:10165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.208734:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.208775:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.208783:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f2b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.208789:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f2b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.208794:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432607.208799:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f2b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.208805:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f2b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.208827:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948435957f00) 00010000:00010000:3.0:1787432607.208830:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432607.208834:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f2b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.208840:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f2b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432607.208888:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+32:11364:x1874258588391424:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 11386us (11723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432607.208897:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 104 00000100:00100000:3.0:1787432607.213022:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432607.213371:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588392064 00000100:00100000:1.0:1787432607.213383:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588392064 00000100:00100000:1.0:1787432607.213460:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:1.0:1787432607.213471:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+32:11364:x1874258588392064:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:1.0:1787432607.213767:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+33:11364:x1874258588392064:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 298us (756us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787432607.213776:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:3.0:1787432607.341372:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432607.341480:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588392320 00000100:00100000:2.0:1787432607.341492:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588392320 00000100:00100000:2.0:1787432607.341560:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 105 00000100:00100000:2.0:1787432607.341572:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+33:11375:x1874258588392320:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787432607.341794:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432607.341818:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f2c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e79 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.341898:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f2c7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.341916:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f2c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.341927:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f2c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.341942:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f2ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.341950:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f2ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.341957:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f2ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342084:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f2d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342094:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342101:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432607.342122:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787432607.342343:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f2c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342351:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f2c7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342358:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f2c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342365:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fa00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432607.342369:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f2c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342377:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f2c7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342389:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:2.0:1787432607.342392:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432607.342397:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f2c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342423:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f2c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342445:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f2ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342451:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f2ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342457:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f2ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342463:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ea00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432607.342466:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f2ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342472:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f2ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342480:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948420766100) 00010000:00010000:2.0:1787432607.342482:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432607.342485:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f2ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342491:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f2ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342542:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f2c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e79 expref: 36 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342557:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f2d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e79 expref: 35 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.342570:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948435957f00) 00010000:00010000:2.0:1787432607.342572:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432607.342575:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85f200, rc 0) 00000100:00100000:2.0:1787432607.342647:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+35:11375:x1874258588392320:12345-192.168.204.24@tcp:101:cat.0 Request processed in 1076us (1285us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787432607.342812:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 105 00000100:00100000:3.0:1787432607.356986:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432607.357123:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588392576 00000100:00100000:1.0:1787432607.357134:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588392576 00000100:00100000:1.0:1787432607.357234:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:1.0:1787432607.357247:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+35:11375:x1874258588392576:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:1.0:1787432607.357563:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+36:11375:x1874258588392576:12345-192.168.204.24@tcp:35:cat.0 Request processed in 319us (587us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787432607.357571:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:3.0:1787432607.381818:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432607.381973:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588392832 00000100:00100000:0.0:1787432607.381984:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588392832 00000100:00100000:0.0:1787432607.382055:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 106 00000100:00100000:0.0:1787432607.382066:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+36:11376:x1874258588392832:12345-192.168.204.24@tcp:36:rm.0 00010000:00010000:0.0:1787432607.382135:0:9020:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1787432607.382205:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f273 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e64 expref: 36 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.382239:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f2d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e79 expref: 35 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.382253:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563f2ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e72 expref: 34 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.382269:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f265 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e5d expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.382279:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948435957f00) 00010000:00010000:0.0:1787432607.382285:0:9020:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432607.382307:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2e3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.382321:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.382345:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.382360:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563f2ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.382368:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563f2ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.382374:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563f2ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.382468:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f2f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.382477:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f2f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.382483:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f2f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787432607.382930:0:9020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1787432607.382942:0:9020:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 418474777127ns, next at 419474774296ns, rc = 0 00010000:00010000:0.0:1787432607.382993:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f2f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383003:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f2f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383011:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f2f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383032:0:9020:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f2f8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383039:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f2f8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383045:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f2f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383065:0:9020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787432607.383087:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f2f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383094:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f2f1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383100:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f2f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383373:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432607.383379:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f2f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383387:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f2f1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383398:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948435957f00) 00010000:00010000:0.0:1787432607.383401:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787432607.383404:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f2f1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383431:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f2f1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383449:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383456:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2e3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383461:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2e3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383466:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94840149f000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432607.383469:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2e3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383474:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2e3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383483:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:0.0:1787432607.383485:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432607.383488:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2e3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383493:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f2e3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787432607.383503:0:9020:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081472ac7 reply state 00000000200843f5 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563f2ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383514:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563f2ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.383526:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948435964d00) 00010000:00010000:0.0:1787432607.383528:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787432607.383532:0:9020:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787432607.383618:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+34:11376:x1874258588392832:12345-192.168.204.24@tcp:36:rm.0 Request processed in 1550us (1808us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787432607.383627:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 106 00010000:00010000:1.0:1787432607.383754:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432607.383761:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f2f8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.383768:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432607.383772:0:9519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f2f8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.383778:0:9519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f2f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.383788:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948435957f00) 00010000:00010000:1.0:1787432607.383790:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787432607.383793:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f2f8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.383799:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f2f8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.383811:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432607.383813:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432607.383814:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432607.464401:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432607.465647:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588393088 00000100:00100000:1.0:1787432607.465660:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588393088 00000100:00100000:1.0:1787432607.465797:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 107 00000100:00100000:1.0:1787432607.465809:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+34:11382:x1874258588393088:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787432607.465835:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432607.465871:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f2ff lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e80 expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.465991:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f306 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.466008:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f306 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.466021:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f306 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.466031:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f30d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.466038:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f30d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.466045:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f30d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787432607.466545:0:10165:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1787432607.466677:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f314 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.466687:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f314 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.466694:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f314 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.466723:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f306 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.466742:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f306 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.466749:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f306 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.466754:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432607.466759:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f306 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.466766:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f306 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.466777:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:1.0:1787432607.466780:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432607.466785:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f306 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.466791:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f306 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787432607.466805:0:10165:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ee42fc9 reply state 000000008b155e0c transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f30d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.466815:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f30d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.466820:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948435964d00) 00010000:00010000:1.0:1787432607.466822:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787432607.466825:0:10165:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787432607.466853:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f2ff lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e80 expref: 37 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.466875:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f314 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e80 expref: 36 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.466883:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff94841318be00) 00010000:00010000:1.0:1787432607.466885:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432607.466887:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851600, rc 0) 00000100:00100000:1.0:1787432607.467029:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+37:11382:x1874258588393088:12345-192.168.204.24@tcp:101:bash.0 Request processed in 1222us (2639us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787432607.467037:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 107 00000100:00100000:2.0:1787432607.471561:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432607.472096:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588393216 00000100:00100000:0.0:1787432607.472109:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588393216 00000100:00100000:0.0:1787432607.472427:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 42 00000100:00100000:0.0:1787432607.472438:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2401:x1874258588393216:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787432607.472457:0:8806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432607.472478:0:8806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f322 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e87 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787432607.472503:0:8806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787432607.472522:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=418s v=(0 0) 00010000:00010000:0.0:1787432607.472527:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432607.472537:0:8806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f322 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e87 expref: 8 pid: 8806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.472567:0:8806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f322 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e87 expref: 8 pid: 8806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.472581:0:8806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948400030e00, rc 0) 00000100:00100000:0.0:1787432607.472636:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2401:x1874258588393216:12345-192.168.204.24@tcp:101:bash.0 Request processed in 199us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.472660:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 42 00000100:00080000:2.0:1787432607.473373:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432607.477584:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432607.477659:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588393344 00000100:00100000:2.0:1787432607.477672:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588393344 00000100:00100000:2.0:1787432607.477731:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 43 00000100:00100000:2.0:1787432607.477742:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:11382:x1874258588393344:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787432607.477759:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432607.477779:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f329 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e8e expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.477809:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f322 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e87 expref: 9 pid: 8806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.477818:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432607.477822:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432607.477827:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f329 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e8e expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.477859:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f322 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e87 expref: 9 pid: 8806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.477888:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f322 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e87 expref: 9 pid: 8806 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432607.477904:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303918000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1874258609443584:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432607.478095:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483026db300 going to sleep for 11 seconds 00000100:00100000:3.0:1787432607.481740:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432607.481926:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588393472 00000100:00100000:1.0:1787432607.481936:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588393472 00010000:00010000:1.0:1787432607.481976:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f322 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e87 expref: 10 pid: 8806 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432607.482024:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 67 00000100:00100000:1.0:1787432607.482034:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f941880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+10:2403:x1874258588393472:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432607.482048:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432607.482071:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f322 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e87 expref: 10 pid: 8806 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.482084:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f322 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e87 expref: 10 pid: 8806 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.482121:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432607.482139:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432607.482148:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f329 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e8e expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.482158:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f329 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e8e expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.482239:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f329 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e8e expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432607.482255:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830443d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6500:1874258609443712:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787432607.482339:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830380d480 going to sleep for 11 seconds 00010000:00010000:2.0:1787432607.482956:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f322 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e87 expref: 10 pid: 8806 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432607.482976:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303918000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1874258609443584:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432607.483006:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f329 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e8e expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.483017:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85ea00, rc 0) 00000100:00100000:2.0:1787432607.483069:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:11382:x1874258588393344:12345-192.168.204.24@tcp:101:bash.0 Request processed in 5328us (5494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432607.483078:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 43 00000100:00100000:1.0:1787432607.488678:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830443d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6500:1874258609443712:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787432607.488710:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432607.488773:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f941880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2403:x1874258588393472:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 6739us (7044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432607.488784:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 67 00000100:00100000:3.0:1787432607.491712:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432607.491802:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588393728 00000100:00100000:1.0:1787432607.491812:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588393728 00000100:00100000:1.0:1787432607.491890:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:1.0:1787432607.492016:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+37:11382:x1874258588393728:12345-192.168.204.24@tcp:35:bash.0 00000100:00100000:1.0:1787432607.492862:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+38:11382:x1874258588393728:12345-192.168.204.24@tcp:35:bash.0 Request processed in 847us (1158us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787432607.492872:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:0.0:1787432607.745607:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432607.745869:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588393856 00000100:00100000:2.0:1787432607.745880:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588393856 00000100:00100000:2.0:1787432607.745948:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 108 00000100:00100000:2.0:1787432607.745960:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+38:11398:x1874258588393856:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432607.745986:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432607.746008:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f330 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e95 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.746101:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f337 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.746116:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.746127:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432607.746208:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787432607.746212:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787432607.746233:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.746257:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f330 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e95 expref: 40 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.746282:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f337 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e95 expref: 39 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.746291:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:2.0:1787432607.748614:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432607.748641:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85ee00, rc 0) 00000100:00100000:2.0:1787432607.748778:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+39:11398:x1874258588393856:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 2810us (3172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432607.748791:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 108 00000100:00100000:0.0:1787432607.756872:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432607.756959:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588394112 00000100:00100000:2.0:1787432607.756971:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588394112 00000100:00100000:2.0:1787432607.757095:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 109 00000100:00100000:2.0:1787432607.757108:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+39:11398:x1874258588394112:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432607.757136:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432607.757161:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f33e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4e9c expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.757352:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f345 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.757367:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.757379:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432607.757390:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787432607.757524:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f33e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e9c expref: 42 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.757549:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f345 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e9c expref: 41 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.757558:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff94841318be00) 00010000:00010000:2.0:1787432607.757561:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432607.757565:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85fe00, rc 0) 00000100:00100000:2.0:1787432607.757630:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+41:11398:x1874258588394112:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 525us (769us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1787432607.757638:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 109 00000100:00100000:0.0:1787432607.763761:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432607.766643:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588394240 00000100:00100000:1.0:1787432607.766661:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588394240 00000100:00100000:1.0:1787432607.766772:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:1.0:1787432607.766785:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+41:2403:x1874258588394240:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432607.766807:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432607.766835:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f345 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e9c expref: 41 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.766863:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff94841318be00) 00010000:00010000:1.0:1787432607.766869:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432607.766950:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+40:2403:x1874258588394240:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 168us (3199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432607.766958:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:3.0:1787432607.768701:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432607.771692:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588394496 00000100:00100000:1.0:1787432607.771710:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588394496 00000100:00100000:1.0:1787432607.771787:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 110 00000100:00100000:1.0:1787432607.771799:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+40:11398:x1874258588394496:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787432607.771825:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432607.771850:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f353 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4ea3 expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.771969:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f35a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.771985:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f35a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.771997:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f35a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432607.772010:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787432607.772147:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f353 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ea3 expref: 43 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.772204:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f35a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ea3 expref: 42 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.772213:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff94841318be00) 00010000:00010000:1.0:1787432607.772216:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787432607.772220:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851c00, rc 0) 00000100:00100000:1.0:1787432607.772371:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+42:11398:x1874258588394496:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 573us (3676us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1787432607.772380:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 110 00000100:00100000:3.0:1787432607.778446:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432607.778552:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588394624 00000100:00100000:0.0:1787432607.778563:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588394624 00000100:00100000:0.0:1787432607.778622:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 44 00000100:00100000:0.0:1787432607.778632:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2400:x1874258588394624:12345-192.168.204.24@tcp:1:lfs.0 00010000:00010000:0.0:1787432607.778695:0:8806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f368 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.778718:0:8806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e8e expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.778728:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432607.778732:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432607.778737:0:8806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f368 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.778778:0:8806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f329 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e8e expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.778807:0:8806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f329 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e8e expref: 8 pid: 8432 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432607.778845:0:8806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8806:1874258609443840:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787432607.778954:0:8806:0:(client.c:2715:ptlrpc_set_wait()) set ffff948402ab23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432607.781305:0:8806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8806:1874258609443840:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432607.781337:0:8806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f368 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432607.785320:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432607.785556:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588394752 00000100:00100000:2.0:1787432607.785580:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588394752 00002000:00100000:2.0:1787432607.785637:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff94843f943100 x1874258588394752/t0(0) o4->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:318/0 lens 504/0 e 0 to 0 dl 1787432618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787432607.785649:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94843f943100 with x1874258588394752 ext(0->8) 00010000:00010000:2.0:1787432607.785659:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f329 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e8e expref: 9 pid: 8432 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.785677:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f329 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e8e expref: 9 pid: 8432 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787432607.785686:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94843f943100 00000100:00100000:2.0:1787432607.785717:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1 00000100:00100000:2.0:1787432607.785728:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2403:x1874258588394752:12345-192.168.204.24@tcp:4:lfs.0 00000100:00100000:0.0:1787432607.787774:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+11:2403:x1874258588394752:12345-192.168.204.24@tcp:4:lfs.0 Request processed in 2036us (2454us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787432607.787799:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1 00002000:00100000:0.0:1787432607.787811:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff94843f943100 x1874258588394752/t4294967303(0) o4->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:318/0 lens 504/448 e 0 to 0 dl 1787432618 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787432607.787822:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94843f943100 with x1874258588394752 ext(0->8) 00010000:00010000:0.0:1787432607.787832:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f329 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e8e expref: 11 pid: 8432 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.787851:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f329 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e8e expref: 11 pid: 8432 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787432607.787860:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94843f943100 00000100:00100000:3.0:1787432607.799291:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432607.799997:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588394880 00000100:00100000:0.0:1787432607.800008:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588394880 00010000:00010000:0.0:1787432607.800066:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f329 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e8e expref: 11 pid: 8432 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432607.800140:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 68 00000100:00100000:0.0:1787432607.800151:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94841223d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+11:2403:x1874258588394880:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432607.800192:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787432607.800210:0:6499:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787432607.800213:0:6499:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787432607 00002000:00010000:0.0:1787432607.800216:0:6499:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787432607 00002000:00010000:0.0:1787432607.800218:0:6499:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787432607 00002000:00010000:0.0:1787432607.800220:0:6499:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787432607.800226:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f329 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e8e expref: 11 pid: 8432 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.800240:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f329 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e8e expref: 11 pid: 8432 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.800265:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f329 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e8e expref: 11 pid: 8432 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.800283:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432607.800288:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432607.800293:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f368 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.800304:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f368 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.800359:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432607.800437:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94841223d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+10:2403:x1874258588394880:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 287us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.800446:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 68 00010000:00010000:2.0:1787432607.800718:0:8806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f368 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.800729:0:8806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f368 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.800761:0:8806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f368 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.800770:0:8806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f368 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.800778:0:8806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f368 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.800902:0:8806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030e00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432607.800908:0:8806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f368 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.800917:0:8806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f368 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.800933:0:8806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f368 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.800942:0:8806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d475fef6/0xca72b3b33563f368 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432607.801055:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2400:x1874258588394624:12345-192.168.204.24@tcp:1:lfs.0 Request processed in 22422us (22617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432607.801064:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 44 00000100:00100000:1.0:1787432607.814758:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432607.814943:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588395136 00000100:00100000:2.0:1787432607.814954:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588395136 00000100:00100000:2.0:1787432607.815007:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 26 00000100:00100000:2.0:1787432607.815018:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948411a1e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+42:11398:x1874258588395136:12345-192.168.204.24@tcp:35:lfs.0 00000004:00010000:2.0:1787432607.815082:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f35a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ea3 expref: 42 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787432607.815327:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1787432607.815361:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787432607.816119:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1787432607.816249:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f36f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.816270:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f314 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e80 expref: 46 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.816280:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f36f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.816324:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f314 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e80 expref: 46 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.816341:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f314 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e80 expref: 46 pid: 10165 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432607.816357:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303918000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6516:1874258609443968:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432607.816453:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787432607.825616:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303918000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6516:1874258609443968:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432607.825649:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f36f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432607.826037:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432607.826147:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588395264 00000100:00100000:0.0:1787432607.826156:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588395264 00010000:00010000:0.0:1787432607.826241:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f314 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e80 expref: 47 pid: 10165 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432607.826288:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 69 00000100:00100000:0.0:1787432607.826300:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+47:2402:x1874258588395264:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432607.826316:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432607.826322:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f314 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e80 expref: 47 pid: 10165 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.826334:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f314 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e80 expref: 47 pid: 10165 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.826355:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f314 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e80 expref: 47 pid: 10165 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.826373:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff94841318be00) 00010000:00010000:0.0:1787432607.826379:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f36f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.826388:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f36f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.826422:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f36f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.826452:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432607.826515:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+46:2402:x1874258588395264:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 216us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.826522:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 69 00010000:00010000:3.0:1787432607.830908:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f36f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.830931:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f36f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787432607.831550:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1787432607.832428:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1787432607.832539:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f941500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874258609444096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787432607.832625:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432607.832705:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432607.832996:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609444096 00000100:00100000:0.0:1787432607.833005:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609444096 00000100:00100000:0.0:1787432607.833119:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787432607.833130:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6516:x1874258609444096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787432607.833287:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6516:x1874258609444096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 158us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.833296:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787432607.833460:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f941500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874258609444096:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787432607.833596:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1787432607.833652:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f941500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874258609444224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787432607.833682:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432607.833963:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432607.834008:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609444224 00000100:00100000:1.0:1787432607.834013:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609444224 00000100:00100000:1.0:1787432607.834043:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787432607.834051:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6516:x1874258609444224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787432607.834415:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6516:x1874258609444224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 363us (730us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787432607.834423:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787432607.834510:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f941500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874258609444224:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787432607.834624:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1787432607.834662:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f36f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.834672:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f36f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.834681:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f36f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.834687:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fa00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432607.834691:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f36f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.834699:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f36f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.834714:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff94841318be00) 00010000:00010000:3.0:1787432607.834717:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787432607.834874:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f36f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.834882:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f36f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787432607.834997:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787432607.835060:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1787432607.835073:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 418926907705ns, next at 419926905612ns, rc = 0 00000001:00080000:3.0:1787432607.835079:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1787432607.835106:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff94841318be00) 00010000:00010000:3.0:1787432607.835109:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787432607.835117:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f35a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ea3 expref: 50 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432607.835355:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948411a1e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+49:11398:x1874258588395136:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 20337us (20606us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787432607.835365:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 26 00000020:00080000:3.0:1787432607.835370:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787432607.838913:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432607.839023:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588395392 00000100:00100000:2.0:1787432607.839034:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588395392 00000100:00100000:2.0:1787432607.839100:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 111 00000100:00100000:2.0:1787432607.839110:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+49:11398:x1874258588395392:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432607.839141:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432607.843183:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f376 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4eaa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.843309:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f376 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eaa expref: 50 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.843326:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f376 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eaa expref: 50 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.843345:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:2.0:1787432607.843348:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787432607.843352:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e600, rc 0) 00000100:00100000:2.0:1787432607.843436:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+50:11398:x1874258588395392:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 4327us (4534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432607.843445:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 111 00000100:00100000:1.0:1787432607.849214:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432607.849313:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588395648 00000100:00100000:3.0:1787432607.849323:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588395648 00000100:00100000:3.0:1787432607.849393:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 27 00000100:00100000:3.0:1787432607.849421:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+50:11398:x1874258588395648:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:3.0:1787432607.849724:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+51:11398:x1874258588395648:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 319us (521us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787432607.849732:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 27 00010000:00010000:0.0:1787432607.947614:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432607.977918:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432607.978061:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588395776 00000100:00100000:2.0:1787432607.978074:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588395776 00000100:00100000:2.0:1787432607.978344:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 112 00000100:00100000:2.0:1787432607.978356:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+51:11408:x1874258588395776:12345-192.168.204.24@tcp:34:lfs.0 00010000:00010000:2.0:1787432607.978453:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f37d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978471:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f37d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978481:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f37d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978493:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f384 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978522:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978529:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978606:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f38b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978615:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f38b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978621:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f38b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432607.978665:0:9020:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f38b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978677:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f37d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978683:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f37d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978690:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f37d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978695:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fc00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432607.978700:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f37d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978707:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f37d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978725:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:2.0:1787432607.978728:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432607.978732:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f37d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978738:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f37d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978760:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978766:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f384 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978772:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f384 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978777:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432607.978779:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f384 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978785:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f384 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978793:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948435964d00) 00010000:00010000:2.0:1787432607.978795:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432607.978798:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f384 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978804:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f384 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978823:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f38b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978828:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f38b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978833:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f38b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978838:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fa00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432607.978841:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f38b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978848:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f38b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978855:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:2.0:1787432607.978857:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432607.978859:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f38b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.978865:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f38b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432607.978957:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+51:11408:x1874258588395776:12345-192.168.204.24@tcp:34:lfs.0 Request processed in 603us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432607.978965:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 112 00000100:00100000:1.0:1787432608.029625:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432608.029804:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588396032 00000100:00100000:0.0:1787432608.029816:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588396032 00000100:00100000:0.0:1787432608.029906:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 113 00000100:00100000:0.0:1787432608.029918:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+51:11411:x1874258588396032:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787432608.029944:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432608.029969:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f392 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4eb1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030067:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f399 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030084:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f399 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787432608.030190:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787432608.030324:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f399 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030339:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f3a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030347:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f3a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030354:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f3a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030510:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563f3a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030520:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563f3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030526:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563f3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432608.030540:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787432608.030627:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f399 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030640:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f399 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030648:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f399 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030654:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400030000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432608.030668:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f399 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030677:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f399 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030691:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:0.0:1787432608.030698:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432608.030703:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f399 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030710:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030000/0xca72b3b33563f399 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030729:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f3a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030736:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f3a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030741:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f3a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030746:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94840149f000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432608.030749:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f3a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030755:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f3a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030762:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948435964d00) 00010000:00010000:0.0:1787432608.030765:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432608.030775:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f3a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030781:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f000/0xca72b3b33563f3a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030821:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030e00/0xca72b3b33563f392 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eb1 expref: 54 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030837:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563f3a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eb1 expref: 53 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.030844:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:0.0:1787432608.030846:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432608.030849:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94840149ec00, rc 0) 00000100:00100000:0.0:1787432608.031210:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+53:11411:x1874258588396032:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1178us (1478us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787432608.031221:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 113 00000100:00100000:3.0:1787432608.035019:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432608.035124:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588396160 00000100:00100000:0.0:1787432608.035133:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588396160 00000100:00100000:0.0:1787432608.035230:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 114 00000100:00100000:0.0:1787432608.035245:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+53:11411:x1874258588396160:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:0.0:1787432608.035344:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563f3b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.035363:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563f3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.035373:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563f3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.035430:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563f3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.035437:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563f3b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.035443:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563f3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.035449:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488a00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432608.035454:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563f3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.035461:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563f3b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.035476:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:0.0:1787432608.035479:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787432608.035482:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563f3b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.035488:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563f3b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432608.035563:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+53:11411:x1874258588396160:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 320us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432608.035570:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 114 00000100:00100000:3.0:1787432608.039147:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432608.039368:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588396416 00000100:00100000:0.0:1787432608.039378:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588396416 00000100:00100000:0.0:1787432608.039443:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 28 00000100:00100000:0.0:1787432608.039461:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+53:11411:x1874258588396416:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:0.0:1787432608.039704:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+54:11411:x1874258588396416:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 243us (567us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1787432608.039712:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 28 00000100:00100000:1.0:1787432608.138487:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432608.138832:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588396672 00000100:00100000:3.0:1787432608.138845:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588396672 00000100:00100000:3.0:1787432608.139349:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 115 00000100:00100000:3.0:1787432608.139363:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+54:11421:x1874258588396672:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787432608.139391:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432608.139394:0:10165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787432608.139434:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f337 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e95 expref: 54 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.139459:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:3.0:1787432608.139463:0:10165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432608.139478:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3bc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4eb8 expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.139590:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f3c3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.139609:0:10165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563f3a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eb1 expref: 54 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.139616:0:10165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f3c3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.139724:0:10165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563f3a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eb1 expref: 54 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.139741:0:10165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563f3a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eb1 expref: 54 pid: 6514 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432608.139777:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609444352:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432608.140032:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432608.145649:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432608.145826:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609444352:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432608.145861:0:10165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f3c3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432608.146623:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588396800 00000100:00100000:0.0:1787432608.146644:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588396800 00010000:00010000:0.0:1787432608.146695:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563f3a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eb1 expref: 55 pid: 6514 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432608.146728:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 70 00000100:00100000:0.0:1787432608.146739:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+55:2402:x1874258588396800:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432608.146756:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432608.146764:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563f3a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eb1 expref: 55 pid: 6514 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.146777:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563f3a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eb1 expref: 55 pid: 6514 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.146799:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94840149ec00/0xca72b3b33563f3a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eb1 expref: 55 pid: 6514 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.146818:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:0.0:1787432608.146823:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f3c3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.146832:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f3c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.146857:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f3c3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.146942:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432608.146996:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+54:2402:x1874258588396800:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 259us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432608.147004:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 70 00010000:00010000:2.0:1787432608.147133:0:10165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f3c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.147149:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f3c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432608.147199:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787432608.147350:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3bc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eb8 expref: 55 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.147366:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f3c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eb8 expref: 54 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.147373:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:2.0:1787432608.147376:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787432608.147379:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303013e00, rc 0) 00000100:00100000:2.0:1787432608.147423:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+54:11421:x1874258588396672:12345-192.168.204.24@tcp:101:bash.0 Request processed in 8063us (8949us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787432608.147430:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 115 00000100:00100000:2.0:1787432608.151489:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432608.151600:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588396928 00000100:00100000:0.0:1787432608.151611:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588396928 00000100:00100000:0.0:1787432608.151689:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 116 00000100:00100000:0.0:1787432608.151700:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830391ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+54:11421:x1874258588396928:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787432608.151724:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432608.151745:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563f3d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4ebf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.151784:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f3d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.151799:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.151811:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.151956:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563f3d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ebf expref: 56 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.151978:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ebf expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.151997:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:0.0:1787432608.152000:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787432608.152006:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304489a00, rc 0) 00000100:00100000:0.0:1787432608.152089:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830391ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+55:11421:x1874258588396928:12345-192.168.204.24@tcp:101:bash.0 Request processed in 390us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432608.152105:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 116 00000100:00100000:1.0:1787432608.157131:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432608.157288:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588397184 00000100:00100000:2.0:1787432608.157299:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588397184 00000100:00100000:2.0:1787432608.157365:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 117 00000100:00100000:2.0:1787432608.157377:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+55:11421:x1874258588397184:12345-192.168.204.24@tcp:36:bash.0 00010000:00010000:2.0:1787432608.157647:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f3df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.157666:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f3df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.157678:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f3df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787432608.157736:0:9020:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1787432608.157760:0:9020:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1fbb386 reply state 00000000caf31b67 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f3df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.157773:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f3df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.157781:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:2.0:1787432608.157784:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787432608.157788:0:9020:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787432608.158050:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+58:11421:x1874258588397184:12345-192.168.204.24@tcp:36:bash.0 Request processed in 674us (931us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787432608.158058:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 117 00000020:00080000:2.0:1787432608.158063:0:9020:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787432608.161281:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432608.161386:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588397312 00000100:00100000:3.0:1787432608.161405:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588397312 00000100:00100000:3.0:1787432608.161498:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 118 00000100:00100000:3.0:1787432608.161509:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+58:11421:x1874258588397312:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787432608.161533:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432608.161554:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f3e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4ec6 expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.161690:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.161705:0:10165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f3c3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eb8 expref: 59 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.161714:0:10165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3ed lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.161753:0:10165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f3c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eb8 expref: 59 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.161767:0:10165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f3c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eb8 expref: 59 pid: 10165 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432608.161789:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609444480:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432608.161887:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787432608.164411:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432608.164531:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609444480:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432608.164558:0:10165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432608.165100:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588397440 00000100:00100000:1.0:1787432608.165122:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588397440 00010000:00010000:1.0:1787432608.165160:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f3c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eb8 expref: 60 pid: 10165 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432608.165210:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 71 00000100:00100000:1.0:1787432608.165221:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+60:2403:x1874258588397440:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432608.165236:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432608.165243:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f3c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eb8 expref: 60 pid: 10165 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.165257:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f3c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eb8 expref: 60 pid: 10165 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.165280:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f3c3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eb8 expref: 60 pid: 10165 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.165297:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:1.0:1787432608.165301:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.165311:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.165318:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3ed lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.165344:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432608.165406:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+59:2403:x1874258588397440:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 177us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432608.165425:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 71 00010000:00010000:1.0:1787432608.165526:0:10165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.165534:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432608.165593:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787432608.165598:0:10165:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432608.165618:0:10165:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.166368:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f3e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ec6 expref: 59 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.166389:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ec6 expref: 58 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.166408:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:1.0:1787432608.166410:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432608.166413:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303012000, rc 0) 00000100:00100000:1.0:1787432608.166467:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+58:11421:x1874258588397312:12345-192.168.204.24@tcp:101:bash.0 Request processed in 4959us (5302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432608.166476:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 118 00000100:00100000:3.0:1787432608.169904:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432608.169982:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588397696 00000100:00100000:0.0:1787432608.169991:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588397696 00000100:00100000:0.0:1787432608.170068:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 29 00000100:00100000:0.0:1787432608.170079:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+58:11421:x1874258588397696:12345-192.168.204.24@tcp:35:bash.0 00000100:00100000:0.0:1787432608.170357:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+59:11421:x1874258588397696:12345-192.168.204.24@tcp:35:bash.0 Request processed in 279us (464us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1787432608.170365:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 29 00000100:00100000:2.0:1787432608.235980:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432608.236124:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588397824 00000100:00100000:1.0:1787432608.236138:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588397824 00000100:00100000:1.0:1787432608.236269:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 119 00000100:00100000:1.0:1787432608.236282:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+59:11427:x1874258588397824:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787432608.236333:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432608.236360:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f3f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4ecd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.236443:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f3fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.236460:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f3fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.236473:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f3fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432608.236524:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787432608.236528:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432608.236550:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f3fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.236580:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f3f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ecd expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.236600:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f3fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ecd expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.236611:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:1.0:1787432608.236614:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432608.236617:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851400, rc 0) 00000100:00100000:1.0:1787432608.236712:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+60:11427:x1874258588397824:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 433us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432608.236720:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 119 00000100:00100000:2.0:1787432608.240615:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432608.240738:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588397952 00000100:00100000:0.0:1787432608.240749:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588397952 00000100:00100000:0.0:1787432608.240815:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 120 00000100:00100000:0.0:1787432608.240826:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+60:11427:x1874258588397952:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787432608.240848:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432608.240871:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563f402 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4ed4 expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.240938:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f409 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.240954:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f409 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.240983:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f409 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.240997:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f410 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241005:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241012:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241113:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f417 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241124:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f417 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241131:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f417 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432608.241237:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787432608.241242:0:9020:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787432608.241262:0:9020:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f417 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241275:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f417 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241283:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f409 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241299:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f409 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241305:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f409 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241311:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432608.241315:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f409 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241323:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f409 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241335:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:0.0:1787432608.241338:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432608.241343:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f409 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241349:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f409 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241364:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241370:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f410 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241375:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f410 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241380:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432608.241389:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f410 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241406:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f410 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241415:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948435964d00) 00010000:00010000:0.0:1787432608.241417:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432608.241421:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f410 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241426:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f410 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241458:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563f402 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ed4 expref: 62 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241473:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f417 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ed4 expref: 61 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.241480:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:0.0:1787432608.241483:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432608.241485:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304489600, rc 0) 00000100:00100000:0.0:1787432608.241565:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+61:11427:x1874258588397952:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 740us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432608.241573:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 120 00000100:00100000:3.0:1787432608.246534:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432608.247313:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588398208 00000100:00100000:1.0:1787432608.247325:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588398208 00000100:00100000:1.0:1787432608.247408:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 121 00000100:00100000:1.0:1787432608.247418:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+61:11427:x1874258588398208:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787432608.247439:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432608.247461:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f41e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4edb expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.247581:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.247598:0:10165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ec6 expref: 62 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.247608:0:10165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f417 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ed4 expref: 62 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.247617:0:10165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.247666:0:10165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f417 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ed4 expref: 62 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.247681:0:10165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f417 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ed4 expref: 62 pid: 9020 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432608.247694:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830443f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609444608:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432608.247975:0:10165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ec6 expref: 62 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.248000:0:10165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ec6 expref: 62 pid: 10165 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432608.248009:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830443c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609444736:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432608.248049:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830380d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432608.251824:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432608.253869:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588398336 00000100:00100000:0.0:1787432608.253885:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588398336 00010000:00010000:0.0:1787432608.253947:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f417 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ed4 expref: 63 pid: 9020 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432608.254074:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 72 00000100:00100000:0.0:1787432608.254087:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+63:2403:x1874258588398336:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432608.254114:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432608.254122:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f417 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ed4 expref: 63 pid: 9020 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.254137:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f417 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ed4 expref: 63 pid: 9020 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.254181:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:0.0:1787432608.254187:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.254197:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.254204:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432608.254318:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+63:2403:x1874258588398336:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 234us (2506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432608.254327:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 72 00000100:00100000:3.0:1787432608.257356:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:2.0:1787432608.257555:0:10165:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.24@tcp) returned -22 from blocking AST (req@000000009cfacf38 x1874258609444608) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f417 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ed4 expref: 62 pid: 9020 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.257578:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f417 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ed4 expref: 62 pid: 9020 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432608.257616:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830443f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609444608:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432608.257641:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830443c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609444736:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432608.257670:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:2.0:1787432608.257676:0:10165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.257686:0:10165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.257694:0:10165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432608.257990:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588398464 00000100:00100000:1.0:1787432608.257998:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588398464 00010000:00010000:1.0:1787432608.258229:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ec6 expref: 62 pid: 10165 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432608.258307:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 73 00000100:00100000:0.0:1787432608.258321:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+62:2402:x1874258588398464:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432608.258336:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432608.258341:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ec6 expref: 62 pid: 10165 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.258380:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ec6 expref: 62 pid: 10165 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.258409:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f3ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ec6 expref: 62 pid: 10165 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.258423:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:0.0:1787432608.258427:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.258435:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.258442:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.258464:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432608.258517:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+61:2402:x1874258588398464:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 200us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432608.258526:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 73 00010000:00010000:3.0:1787432608.258585:0:10165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.258594:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432608.258612:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787432608.258776:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f41e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4edb expref: 62 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.258792:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4edb expref: 61 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.258799:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:3.0:1787432608.258801:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787432608.258805:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850800, rc 0) 00000100:00100000:3.0:1787432608.258831:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+61:11427:x1874258588398208:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 11415us (12313us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1787432608.258838:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 121 00000100:00100000:2.0:1787432608.265048:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432608.265382:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588398720 00000100:00100000:1.0:1787432608.265406:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588398720 00000100:00100000:1.0:1787432608.265502:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:1.0:1787432608.265515:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+61:11427:x1874258588398720:12345-192.168.204.24@tcp:103:lfs.0 00010000:00010000:1.0:1787432608.265532:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432608.265557:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f376 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4eaa expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.265580:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:1.0:1787432608.265586:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432608.265742:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+60:11427:x1874258588398720:12345-192.168.204.24@tcp:103:lfs.0 Request processed in 230us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432608.265750:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:3.0:1787432608.268125:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432608.268233:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588398848 00000100:00100000:2.0:1787432608.268245:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588398848 00000100:00100000:2.0:1787432608.268304:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 122 00000100:00100000:2.0:1787432608.268315:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+60:11427:x1874258588398848:12345-192.168.204.24@tcp:58:lfs.0 00010000:00010000:2.0:1787432608.268441:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f433 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.268460:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f433 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.268473:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f433 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787432608.268568:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787432608.269119:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+60:11427:x1874258588398848:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 802us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432608.269129:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 122 00000100:00100000:3.0:1787432608.271599:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432608.271721:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588398976 00000100:00100000:2.0:1787432608.271737:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588398976 00000100:00100000:2.0:1787432608.271786:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 123 00000100:00100000:2.0:1787432608.271795:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+60:11427:x1874258588398976:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432608.271816:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432608.271840:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f43a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4ee2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.271894:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f433 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.271904:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f43a lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ee2 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.271925:0:6514:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f433 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.271939:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f43a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ee2 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.271953:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:2.0:1787432608.271956:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787432608.271960:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f43a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ee2 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.271967:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85f800, rc 0) 00000100:00100000:2.0:1787432608.272042:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+61:11427:x1874258588398976:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 247us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432608.272050:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 123 00000040:00080000:2.0:1787432608.524127:0:13810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787432608.524140:0:13810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787432608.524188:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787432608.524199:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787432608.524352:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13810:1874258609444864:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787432608.525013:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787432608.533592:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432608.533668:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13810:1874258609444864:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787432608.533983:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588399104 00000100:00100000:0.0:1787432608.533993:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588399104 00000100:00100000:0.0:1787432608.534060:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 124 00000100:00100000:0.0:1787432608.534071:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+61:11428:x1874258588399104:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787432608.534132:0:10165:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787432608.534314:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+61:11428:x1874258588399104:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 244us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432608.534335:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 124 00000100:00100000:0.0:1787432608.543956:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432608.544623:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588399232 00000100:00100000:2.0:1787432608.544647:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588399232 00000100:00100000:2.0:1787432608.544719:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 125 00000100:00100000:2.0:1787432608.544730:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+61:11428:x1874258588399232:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787432608.545214:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f441 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.545239:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f441 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.545252:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f441 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.545290:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f448 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.545298:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f448 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.545328:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f448 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.545353:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f44f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.545363:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f44f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.545369:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f44f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432608.545438:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787432608.545443:0:9020:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787432608.545455:0:9020:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f44f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.545466:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f441 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.545472:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f441 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.545479:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f441 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.545485:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ea00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432608.545489:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f441 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.545496:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f441 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.546116:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94841318b400) 00010000:00010000:2.0:1787432608.546121:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432608.546128:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f441 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.546137:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f441 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.546290:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f448 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.546297:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f448 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.546303:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f448 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.546308:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85f200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432608.546311:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f448 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.546318:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f448 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.546331:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff948420766c00) 00010000:00010000:2.0:1787432608.546334:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432608.546337:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f448 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.546343:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f448 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.546376:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f44f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.546382:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f44f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.546401:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f44f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.546407:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432608.546410:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f44f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.546415:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f44f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.546423:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:2.0:1787432608.546426:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432608.546429:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f44f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.546434:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f44f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432608.546566:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+61:11428:x1874258588399232:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 1830us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432608.546579:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 125 00000100:00100000:3.0:1787432608.552526:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432608.552667:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588399488 00000100:00100000:0.0:1787432608.552678:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588399488 00000100:00100000:0.0:1787432608.552750:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 126 00000100:00100000:0.0:1787432608.552761:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+61:11428:x1874258588399488:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432608.552782:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432608.552804:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f456 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4ee9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.552913:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f45d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.552932:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f45d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.552953:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f45d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432608.552967:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787432608.553062:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f45d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.553070:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f45d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.553076:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f45d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.553236:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488800 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432608.553259:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f45d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.553268:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f45d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.553282:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:0.0:1787432608.553287:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787432608.553291:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f45d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.553296:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f45d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.553343:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f456 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ee9 expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.553353:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94841318b400) 00010000:00010000:0.0:1787432608.553356:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787432608.553359:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f456 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ee9 expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.553368:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304488000, rc 0) 00000100:00100000:0.0:1787432608.553455:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+62:11428:x1874258588399488:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 696us (943us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1787432608.553464:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 126 00000100:00100000:3.0:1787432608.567766:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432608.567936:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588399616 00000100:00100000:2.0:1787432608.567955:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588399616 00000100:00100000:2.0:1787432608.568017:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 127 00000100:00100000:2.0:1787432608.568044:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+62:11428:x1874258588399616:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787432608.568081:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787432608.568246:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+62:11428:x1874258588399616:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 204us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432608.568253:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 127 00000100:00100000:2.0:1787432608.574326:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432608.583065:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588399872 00000100:00100000:0.0:1787432608.583083:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588399872 00000100:00100000:0.0:1787432608.583259:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 128 00000100:00100000:0.0:1787432608.583271:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+62:11428:x1874258588399872:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432608.583307:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432608.583311:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787432608.583340:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f3fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ecd expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.583361:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:0.0:1787432608.583366:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432608.583379:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f46b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4ef0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787432608.588309:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1787432608.590026:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f472 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.590051:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.590064:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.590162:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f46b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ef0 expref: 64 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.590218:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f472 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ef0 expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.590228:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948435964a00) 00010000:00010000:0.0:1787432608.590231:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432608.590261:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304488800, rc 0) 00000100:00100000:0.0:1787432608.590350:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+63:11428:x1874258588399872:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 7080us (16034us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787432608.590360:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 128 00000100:00100000:3.0:1787432608.595314:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432608.595496:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588400128 00000100:00100000:1.0:1787432608.595518:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588400128 00000100:00100000:1.0:1787432608.595582:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 129 00000100:00100000:1.0:1787432608.595594:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+63:11428:x1874258588400128:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787432608.595654:0:10165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432608.595682:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f472 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ef0 expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.595716:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948435964a00) 00010000:00010000:1.0:1787432608.595727:0:10165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432608.595749:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f480 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.595762:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f480 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.595771:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f480 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.595785:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f487 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x43c64d2b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.595792:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f487 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x43c64d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.595798:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f487 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x43c64d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.595839:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f480 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.595846:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f480 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.595871:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f480 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.595878:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851a00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432608.595882:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f480 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.595889:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f480 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.595898:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:1.0:1787432608.595900:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432608.595904:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f480 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.595910:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f480 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.595920:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f487 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x43c64d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.596156:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f487 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x43c64d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.596161:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f487 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x43c64d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.596191:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432608.596194:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f487 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x43c64d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.596209:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f487 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x43c64d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.596217:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x43c64d2b (ffff94841318b800) 00010000:00010000:1.0:1787432608.596220:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432608.596222:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f487 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x43c64d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.596227:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f487 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x43c64d2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432608.596304:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+62:11428:x1874258588400128:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 712us (1000us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787432608.596313:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 129 00000100:00100000:3.0:1787432608.599065:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432608.605813:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588400256 00000100:00100000:0.0:1787432608.605828:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588400256 00000100:00100000:2.0:1787432608.607262:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 130 00000100:00100000:2.0:1787432608.607276:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+62:11428:x1874258588400256:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787432608.607300:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432608.607325:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f48e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4ef7 expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.607362:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f495 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.607376:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.607396:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.607546:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f48e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ef7 expref: 64 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.607573:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f495 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ef7 expref: 63 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.607582:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948420766c00) 00010000:00010000:2.0:1787432608.607591:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787432608.607595:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85ea00, rc 0) 00000100:00100000:2.0:1787432608.607680:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+63:11428:x1874258588400256:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 406us (8627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432608.607688:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 130 00000100:00100000:2.0:1787432608.616062:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432608.616528:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588400512 00000100:00100000:1.0:1787432608.616539:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588400512 00000100:00100000:1.0:1787432608.616674:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 131 00000100:00100000:1.0:1787432608.616685:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+63:11428:x1874258588400512:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787432608.616795:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f49c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.616812:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f49c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.616825:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f49c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787432608.617034:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1787432608.617046:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 419708880621ns, next at 420708877335ns, rc = 0 00000004:00010000:1.0:1787432608.617110:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029b336f5 reply state 0000000075915d8e transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f49c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.617124:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f49c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.617132:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948420766c00) 00010000:00010000:1.0:1787432608.617136:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787432608.617140:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787432608.617300:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+65:11428:x1874258588400512:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 615us (1249us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787432608.617308:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 131 00000100:00100000:3.0:1787432608.620738:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432608.620834:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588400640 00000100:00100000:2.0:1787432608.620844:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588400640 00000100:00100000:2.0:1787432608.620918:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 132 00000100:00100000:2.0:1787432608.620930:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+65:11428:x1874258588400640:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787432608.620967:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432608.620992:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f4a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4efe expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.621055:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f4a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4efe expref: 66 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.621070:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f4a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4efe expref: 66 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.621089:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948420766c00) 00010000:00010000:2.0:1787432608.621092:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787432608.621096:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85f200, rc 0) 00000100:00100000:2.0:1787432608.621160:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+66:11428:x1874258588400640:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 233us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432608.621190:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 132 00000100:00100000:3.0:1787432608.629347:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432608.629526:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588400768 00000100:00100000:1.0:1787432608.629539:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588400768 00000100:00080000:2.0:1787432608.629875:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432608.630120:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 45 00000100:00100000:1.0:1787432608.630136:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2403:x1874258588400768:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787432608.630572:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2403:x1874258588400768:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 439us (1235us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787432608.630580:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 45 00000100:00100000:3.0:1787432608.636046:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432608.636134:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588401024 00000100:00100000:0.0:1787432608.636146:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588401024 00000100:00100000:0.0:1787432608.636250:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 30 00000100:00100000:0.0:1787432608.636262:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+66:11428:x1874258588401024:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787432608.636522:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+67:11428:x1874258588401024:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 261us (487us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1787432608.636531:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 30 00000100:00100000:3.0:1787432608.642113:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432608.649616:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588401280 00000100:00100000:2.0:1787432608.649635:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588401280 00000100:00100000:2.0:1787432608.649786:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 133 00000100:00100000:2.0:1787432608.649798:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+67:11428:x1874258588401280:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787432608.649955:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+67:11428:x1874258588401280:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 159us (7854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432608.649962:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 133 00000100:00100000:2.0:1787432608.662848:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432608.663067:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588401408 00000100:00100000:1.0:1787432608.663077:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588401408 00000100:00100000:1.0:1787432608.663143:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 134 00000100:00100000:1.0:1787432608.663154:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+67:11428:x1874258588401408:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432608.663201:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432608.663225:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f4aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f05 expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.663318:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f4b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.663347:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.663359:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432608.663419:0:10165:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432608.663438:0:10165:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.663466:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f4aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f05 expref: 69 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.663486:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f4b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f05 expref: 68 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.663494:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948420766c00) 00010000:00010000:1.0:1787432608.663496:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787432608.663500:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850000, rc 0) 00000100:00100000:1.0:1787432608.663748:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+68:11428:x1874258588401408:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 594us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432608.663755:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 134 00000100:00100000:3.0:1787432608.668810:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432608.668936:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588401536 00000100:00100000:1.0:1787432608.668948:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588401536 00000100:00100000:1.0:1787432608.669011:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 46 00000100:00100000:1.0:1787432608.669022:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2402:x1874258588401536:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432608.669043:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432608.669078:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b33563f4b8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f0c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787432608.669106:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a0ea0, blocks: 0x0 00010000:00010000:1.0:1787432608.669129:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=419s v=(0 0) 00010000:00010000:1.0:1787432608.669134:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432608.669146:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b33563f4b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f0c expref: 10 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.669214:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b33563f4b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f0c expref: 10 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.669230:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851c00, rc 0) 00000100:00100000:1.0:1787432608.669308:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+10:2402:x1874258588401536:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 289us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432608.669316:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 46 00000100:00100000:2.0:1787432608.678718:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432608.679033:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588401792 00000100:00100000:1.0:1787432608.679046:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588401792 00000100:00100000:1.0:1787432608.679120:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 135 00000100:00100000:1.0:1787432608.679132:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+68:11428:x1874258588401792:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787432608.679300:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+68:11428:x1874258588401792:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 170us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432608.679308:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 135 00000100:00100000:3.0:1787432608.682575:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432608.682846:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588401920 00000100:00100000:1.0:1787432608.682867:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588401920 00000100:00100000:1.0:1787432608.682935:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 47 00000100:00100000:1.0:1787432608.682946:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+10:11428:x1874258588401920:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432608.682979:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432608.683009:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b33563f4bf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f13 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.683044:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b33563f4b8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f0c expref: 11 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.683052:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432608.683057:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432608.683062:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b33563f4bf lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f13 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.683279:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b33563f4b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f0c expref: 11 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.683293:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b33563f4b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f0c expref: 11 pid: 8431 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432608.683309:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830443dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874258609444992:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432608.683487:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830380d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787432608.685759:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830443dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874258609444992:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432608.685798:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b33563f4bf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f13 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.685818:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851a00, rc 0) 00000100:00100000:1.0:1787432608.685898:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+11:11428:x1874258588401920:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2953us (3335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432608.685907:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 47 00000100:00100000:3.0:1787432608.686378:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432608.686463:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588402048 00000100:00100000:0.0:1787432608.686472:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588402048 00010000:00010000:0.0:1787432608.686505:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b33563f4b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f0c expref: 11 pid: 8431 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432608.686556:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 74 00000100:00100000:0.0:1787432608.686566:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94841223f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+11:2402:x1874258588402048:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432608.686579:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432608.686604:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b33563f4b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f0c expref: 11 pid: 8431 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.686617:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b33563f4b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f0c expref: 11 pid: 8431 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.686653:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b33563f4b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f0c expref: 11 pid: 8431 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.686668:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432608.686673:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432608.686682:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b33563f4bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f13 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.686692:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b33563f4bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f13 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.686729:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b33563f4bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f13 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432608.686742:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a80380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6499:1874258609445120:192.168.204.24@tcp:105: 00000100:00100000:0.0:1787432608.686850:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358e1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432608.690009:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a80380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6499:1874258609445120:192.168.204.24@tcp:105: 00010000:00010000:0.0:1787432608.690044:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432608.690120:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94841223f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+10:2402:x1874258588402048:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 3554us (3741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432608.690132:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 74 00000100:00100000:2.0:1787432608.691615:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432608.691750:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588402176 00000100:00100000:0.0:1787432608.691759:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588402176 00002000:00100000:0.0:1787432608.691806:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff948435ba9500 x1874258588402176/t0(0) o4->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:319/0 lens 504/0 e 0 to 0 dl 1787432619 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787432608.691829:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948435ba9500 with x1874258588402176 ext(0->12) 00002000:00010000:0.0:1787432608.691835:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948435ba9500 00000100:00100000:0.0:1787432608.691874:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 2 00000100:00100000:0.0:1787432608.691884:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+10:2403:x1874258588402176:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787432608.693373:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+12:2403:x1874258588402176:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 1483us (1760us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787432608.693396:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 2 00002000:00100000:0.0:1787432608.693406:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff948435ba9500 x1874258588402176/t4294967309(0) o4->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:319/0 lens 504/448 e 0 to 0 dl 1787432619 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787432608.693416:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948435ba9500 with x1874258588402176 ext(0->12) 00002000:00010000:0.0:1787432608.693421:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948435ba9500 00000100:00100000:1.0:1787432608.715579:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432608.715605:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609445248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432608.715683:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432608.715929:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609445248 00000100:00100000:2.0:1787432608.715939:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609445248 00000100:00100000:2.0:1787432608.715997:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787432608.716008:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609445248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787432608.716049:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787432608.716104:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609445248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432608.716112:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787432608.716218:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609445248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432608.719161:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432608.719288:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588402304 00000100:00100000:3.0:1787432608.719298:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588402304 00000100:00100000:3.0:1787432608.719376:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 136 00000100:00100000:3.0:1787432608.719397:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+68:11428:x1874258588402304:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787432608.726097:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1787432608.726116:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1787432608.729124:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1787432608.729145:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1787432608.729207:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787432608.729230:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9484210f4b40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787432608.729235:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9483024ce300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9484210f4780 00000020:00080000:0.0:1787432608.729239:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff948409364a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94843f97d600 00000004:00080000:0.0:1787432608.729266:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787432608.729292:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94830380de40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787432608.729295:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9484335ae200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94830380d000 00000020:00080000:0.0:1787432608.729313:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9484335aee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94843f97ca00 00000020:00080000:0.0:1787432608.729337:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787432608.729412:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787432608.729590:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609445504:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787432608.729655:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432608.729690:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432608.729696:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609445376:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787432608.729730:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432608.729777:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609445504 00000100:00100000:2.0:1787432608.729785:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609445504 00000100:00100000:2.0:1787432608.729848:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609445376 00000100:00100000:2.0:1787432608.729851:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609445376 00000100:00100000:2.0:1787432608.729884:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787432608.729894:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3642:x1874258609445504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787432608.730021:0:8806:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787432608.730025:0:8806:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787432608 00002000:00010000:2.0:1787432608.730027:0:8806:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787432608.730029:0:8806:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787432608 -> 1787432608 00002000:00010000:2.0:1787432608.730032:0:8806:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787432608.730072:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3642:x1874258609445504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (416us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787432608.730079:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787432608.730097:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787432608.730103:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3642:x1874258609445376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787432608.730117:0:8806:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:2.0:1787432608.730135:0:8806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.730160:0:8806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c456bbf/0xca72b3b33563f27a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e6b expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.730196:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787432608.730201:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432608.730205:0:8806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4c6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.730231:0:8806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c456bbf/0xca72b3b33563f27a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e6b expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.730254:0:8806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c456bbf/0xca72b3b33563f27a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e6b expref: 11 pid: 8432 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432608.730266:0:8806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8806:1874258609445632:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432608.730329:0:8806:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f000 going to sleep for 11 seconds 00000100:00080000:2.0:1787432608.730344:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787432608.730378:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff948303a9f480/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787432608.730394:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609445504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787432608.730884:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432608.730895:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609445760:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787432608.730926:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432608.731091:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:11428:x1874258588402304:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 11703us (11938us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432608.731100:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 136 00000100:00100000:2.0:1787432608.731313:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609445760 00000100:00100000:2.0:1787432608.731320:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609445760 00000100:00100000:2.0:1787432608.731360:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787432608.731369:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609445760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787432608.731398:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:2.0:1787432608.731425:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8a0e9f, atime: 0x6a8a0e9f, ctime: 0x6a8a0e9f, blocks: 0x8 00010000:00010000:2.0:1787432608.731433:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563f4cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.731445:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1787432608.731449:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432608.731455:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563f4cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.731472:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563f4cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.731498:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563f4cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.731506:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563f4cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731680:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f1c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731688:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f1c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731694:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f1c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731700:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432608.731704:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f1c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731711:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f1c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731725:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff948435964300) 00010000:00010000:1.0:1787432608.731727:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432608.731732:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f1c4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731738:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f1c4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731819:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f26c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731889:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f26c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731894:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f26c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731899:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400031600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432608.731902:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f26c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731908:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f26c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731916:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff948435957f00) 00010000:00010000:1.0:1787432608.731919:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432608.731921:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f26c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731926:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400031600/0xca72b3b33563f26c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731944:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563f2ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731950:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563f2ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731955:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563f2ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731966:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94840149f200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432608.731969:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563f2ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731975:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563f2ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731983:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948435964d00) 00010000:00010000:1.0:1787432608.731985:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432608.731988:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563f2ea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.731992:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94840149f200/0xca72b3b33563f2ea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.732004:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f30d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.732010:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f30d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.732015:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f30d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.732019:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432608.732021:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f30d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.732026:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f30d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.732044:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948435964d00) 00010000:00010000:1.0:1787432608.732047:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432608.732049:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f30d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.732055:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f30d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.732069:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f3df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.732074:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f3df lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.732079:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f3df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.732084:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fc00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432608.732087:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f3df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.732093:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f3df lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.734965:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787432608.735243:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874258609445760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3869us (4310us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787432608.735256:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1787432608.735402:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:1.0:1787432608.735407:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432608.735417:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f3df lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.735426:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b33563f3df lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.735474:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f49c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.735480:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f49c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.735487:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f49c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.735493:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432608.735497:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f49c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.735504:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f49c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432608.735780:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787432608.735786:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967304 00000004:00080000:3.0:1787432608.735805:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94843f919c00, transno 4294967302 00000004:00080000:3.0:1787432608.735814:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967304 00000100:00100000:3.0:1787432608.735837:0:3644:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff948304460380 x1874258609445760/t4294967305(4294967305) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787432624 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787432608.735849:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff948304460380/2, rc 0, transno 4294967305 00000100:00100000:3.0:1787432608.735855:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609445760:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787432608.735983:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:1.0:1787432608.736087:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948420766c00) 00010000:00010000:1.0:1787432608.736089:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787432608.736093:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f49c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.736100:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f49c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432608.736626:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588402432 00000100:00100000:2.0:1787432608.736635:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588402432 00000100:00100000:2.0:1787432608.736689:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 51 00000100:00100000:2.0:1787432608.736700:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+12:2403:x1874258588402432:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1787432608.737622:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432608.737632:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563f4cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.737645:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e600 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432608.737650:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563f4cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.737661:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563f4cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.737680:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563f4cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.737688:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563f4cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.737712:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432608.737713:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432608.737715:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432608.741329:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432608.741462:0:8806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8806:1874258609445632:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432608.741498:0:8806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432608.741682:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588402560 00000100:00100000:1.0:1787432608.741692:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588402560 00010000:00010000:1.0:1787432608.741729:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c456bbf/0xca72b3b33563f27a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e6b expref: 13 pid: 8432 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432608.741759:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 75 00000100:00100000:1.0:1787432608.741776:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+13:2402:x1874258588402560:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432608.741792:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432608.741798:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c456bbf/0xca72b3b33563f27a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e6b expref: 13 pid: 8432 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.741811:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c456bbf/0xca72b3b33563f27a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e6b expref: 13 pid: 8432 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.741836:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c456bbf/0xca72b3b33563f27a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e6b expref: 13 pid: 8432 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.741854:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787432608.741859:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787432608.741865:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.741876:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4c6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.741909:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432608.741975:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+12:2402:x1874258588402560:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 200us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432608.741982:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 75 00010000:00010000:0.0:1787432608.742432:0:8806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.742442:0:8806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.742454:0:8806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.742462:0:8806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.742482:0:8806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787432608.742705:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3642:x1874258609445376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12601us (12973us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787432608.742715:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:3.0:1787432608.742877:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff948303a9d180/2, rc 0, transno 4294967311 00000100:00100000:3.0:1787432608.742884:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609445376:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787432608.743339:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432608.743348:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.743371:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432608.743376:0:9519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.743398:0:9519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.743416:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.743423:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.743443:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432608.743445:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432608.743446:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787432608.743958:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1787432608.743969:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1787432608.744815:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588402432:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 8108us (8824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432608.744827:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 51 00000100:00100000:2.0:1787432608.753493:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432608.753651:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588402816 00000100:00100000:1.0:1787432608.753663:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588402816 00000100:00100000:1.0:1787432608.753725:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 137 00000100:00100000:1.0:1787432608.753734:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:11428:x1874258588402816:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787432608.753793:0:10165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432608.753820:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f4b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f05 expref: 16 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.753863:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948420766c00) 00010000:00010000:1.0:1787432608.753868:0:10165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432608.753903:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f4d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.753918:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.753928:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787432608.754063:0:10165:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3040a8c reply state 00000000816f92a7 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.754075:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f4d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.754093:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948420766c00) 00010000:00010000:1.0:1787432608.754096:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787432608.754099:0:10165:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787432608.754270:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+17:11428:x1874258588402816:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 536us (787us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1787432608.754277:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 137 00000100:00100000:3.0:1787432608.761934:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432608.762045:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588402944 00000100:00100000:2.0:1787432608.762054:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588402944 00000100:00100000:2.0:1787432608.762117:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00100000:2.0:1787432608.762128:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2402:x1874258588402944:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787432608.762324:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787432608.762341:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1787432608 -> 1787432607 00002000:00010000:2.0:1787432608.762343:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787432607 00002000:00010000:2.0:1787432608.762346:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787432608 -> 1787432607 00002000:00010000:2.0:1787432608.762348:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787432608.762421:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2402:x1874258588402944:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 294us (496us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787432608.762429:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00100000:0.0:1787432608.789292:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432608.791012:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588403200 00000100:00100000:2.0:1787432608.791028:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588403200 00000100:00100000:2.0:1787432608.791108:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 138 00000100:00100000:2.0:1787432608.791121:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+17:11428:x1874258588403200:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787432608.791235:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f4db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.791256:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f495 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ef7 expref: 17 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.791267:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f4db lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.791306:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f495 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ef7 expref: 17 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.791321:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f495 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ef7 expref: 17 pid: 9020 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432608.791336:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874258609445888:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432608.791440:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432608.795372:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874258609445888:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432608.795415:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f4db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432608.802346:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432608.802557:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588403328 00000100:00100000:1.0:1787432608.802568:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588403328 00010000:00010000:1.0:1787432608.802610:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f495 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ef7 expref: 18 pid: 9020 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432608.802658:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 76 00000100:00100000:1.0:1787432608.802686:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:2402:x1874258588403328:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432608.802709:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432608.802719:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f495 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ef7 expref: 18 pid: 9020 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.802734:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f495 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ef7 expref: 18 pid: 9020 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.802758:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f495 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ef7 expref: 18 pid: 9020 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.802798:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948420766c00) 00010000:00010000:1.0:1787432608.802804:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f4db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.802817:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f4db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.802826:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f4db lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.802867:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432608.802938:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+17:2402:x1874258588403328:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 255us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432608.802947:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 76 00010000:00010000:2.0:1787432608.803205:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f4db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.803215:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f4db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.803259:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f4db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.803267:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f4db lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.803273:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f4db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.803279:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432608.803284:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f4db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.803291:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f4db lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.803301:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948420766c00) 00010000:00010000:2.0:1787432608.803304:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787432608.803307:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f4db lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.803313:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f4db lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432608.803370:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:11428:x1874258588403200:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 12251us (14088us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787432608.803379:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 138 00000100:00100000:0.0:1787432608.809561:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432608.809713:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588403456 00000100:00100000:2.0:1787432608.809724:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588403456 00000100:00100000:2.0:1787432608.809794:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 53 00000100:00100000:2.0:1787432608.809806:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2403:x1874258588403456:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787432608.809862:0:8806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4e2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.809885:0:8806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b33563f4bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f13 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.809894:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432608.809899:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432608.809903:0:8806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4e2 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.809941:0:8806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b33563f4bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f13 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.809956:0:8806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b33563f4bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f13 expref: 7 pid: 8430 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432608.809971:0:8806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8806:1874258609446016:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432608.810075:0:8806:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432608.824273:0:8806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8806:1874258609446016:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432608.824304:0:8806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4e2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432608.829972:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432608.830338:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588403584 00000100:00100000:1.0:1787432608.830349:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588403584 00010000:00010000:1.0:1787432608.830404:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b33563f4bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f13 expref: 8 pid: 8430 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432608.830477:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 77 00000100:00100000:1.0:1787432608.830488:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2403:x1874258588403584:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432608.830505:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432608.830528:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b33563f4bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f13 expref: 8 pid: 8430 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.830544:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b33563f4bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f13 expref: 8 pid: 8430 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.830571:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b33563f4bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f13 expref: 8 pid: 8430 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.830591:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787432608.830596:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787432608.830603:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4e2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.830613:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4e2 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.830666:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432608.830726:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2403:x1874258588403584:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 239us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432608.830734:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 77 00010000:00010000:0.0:1787432608.831791:0:8806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4e2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.831807:0:8806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4e2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.831853:0:8806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4e2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.831860:0:8806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4e2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.831868:0:8806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.831875:0:8806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432608.831880:0:8806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.831888:0:8806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.831904:0:8806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4e2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.831912:0:8806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0a69b53/0xca72b3b33563f4e2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432608.832000:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588403456:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 22194us (22448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432608.832011:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 53 00000100:00100000:0.0:1787432608.848931:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432608.849099:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588403840 00000100:00100000:3.0:1787432608.849111:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588403840 00000100:00100000:3.0:1787432608.849212:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 139 00000100:00100000:3.0:1787432608.849224:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:11428:x1874258588403840:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787432608.849319:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f4e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.849339:0:9020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f3d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ebf expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.849351:0:9020:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f4e9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.849404:0:9020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ebf expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.849419:0:9020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f3d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ebf expref: 16 pid: 6514 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432608.849434:0:9020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304460a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9020:1874258609446144:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432608.849534:0:9020:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f4780 going to sleep for 11 seconds 00000100:00100000:0.0:1787432608.852082:0:9020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304460a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9020:1874258609446144:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432608.852115:0:9020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f4e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432608.855981:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432608.856285:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588403968 00000100:00100000:1.0:1787432608.856295:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588403968 00010000:00010000:1.0:1787432608.856338:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f3d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ebf expref: 17 pid: 6514 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432608.856399:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 78 00000100:00100000:1.0:1787432608.856409:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+17:2403:x1874258588403968:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432608.856424:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432608.856432:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f3d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ebf expref: 17 pid: 6514 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.856447:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ebf expref: 17 pid: 6514 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.856471:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f3d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ebf expref: 17 pid: 6514 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.856491:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:1.0:1787432608.856498:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f43a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ee2 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.856509:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f4e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.856518:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.856527:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f4e9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.856593:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432608.856670:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:2403:x1874258588403968:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 262us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432608.856679:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 78 00010000:00010000:3.0:1787432608.856761:0:9020:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.856769:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.856967:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f4f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.856981:0:9020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f4a3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4efe expref: 16 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.856989:0:9020:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f4f0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.857024:0:9020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f4a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4efe expref: 16 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432608.857038:0:9020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f4a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4efe expref: 16 pid: 10165 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432608.857054:0:9020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304460700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9020:1874258609446272:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432608.879361:0:9020:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f4780 going to sleep for 11 seconds 00000100:00100000:0.0:1787432608.882877:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432608.882996:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588404096 00000100:00100000:1.0:1787432608.883006:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588404096 00010000:00010000:1.0:1787432608.883055:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f4a3 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4efe expref: 17 pid: 10165 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432608.883105:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 79 00000100:00100000:1.0:1787432608.883116:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+17:2402:x1874258588404096:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432608.883161:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432608.883199:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f4a3 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4efe expref: 17 pid: 10165 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.883214:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f4a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4efe expref: 17 pid: 10165 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.883245:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948420766c00) 00010000:00010000:1.0:1787432608.883252:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f4f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.883264:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f4f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.883273:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f4f0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.883310:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432608.883369:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+17:2402:x1874258588404096:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 254us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432608.883376:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 79 00010000:00010000:2.0:1787432608.883637:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f4a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4efe expref: 16 pid: 10165 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432608.883660:0:9020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304460700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9020:1874258609446272:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432608.883689:0:9020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f4f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.883698:0:9020:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f4f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.883704:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f4f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787432608.883846:0:9020:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1787432608.883980:0:9020:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1787432608.884019:0:9020:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1787432608.884105:0:9020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9020:1874258609446400:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787432608.884161:0:9020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432608.884242:0:9020:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f180 going to sleep for 11 seconds 00000100:00100000:3.0:1787432608.884420:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609446400 00000100:00100000:3.0:1787432608.884426:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609446400 00000100:00100000:3.0:1787432608.884470:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787432608.884479:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9020:x1874258609446400:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787432608.884563:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9020:x1874258609446400:12345-0@lo:1000:mdt00_003.0 Request processed in 85us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432608.884584:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787432608.884809:0:9020:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787432608.884815:0:9020:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:1.0:1787432608.884835:0:9020:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff948303a9f480, transno 4294967310 00000100:00100000:1.0:1787432608.884859:0:9020:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff948303a9d180 x1874258609445376/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787432624 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432608.884870:0:9020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9020:1874258609446400:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787432608.884988:0:9020:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1787432608.885040:0:9020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830443f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9020:1874258609446528:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787432608.885072:0:9020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432608.885100:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609446528 00000100:00100000:1.0:1787432608.885104:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609446528 00000100:00100000:1.0:1787432608.885128:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787432608.885135:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9020:x1874258609446528:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787432608.885270:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9020:x1874258609446528:12345-0@lo:1000:mdt00_003.0 Request processed in 135us (197us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787432608.885278:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787432608.885299:0:9020:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830380dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432608.885317:0:9020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830443f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9020:1874258609446528:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787432608.885350:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f4f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.885373:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f4f0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.885399:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f4f0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.885406:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303012800 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432608.885410:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f4f0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.885418:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f4f0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.885436:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948420766c00) 00010000:00010000:1.0:1787432608.885439:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787432608.885444:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f4f0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.885450:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f4f0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.885477:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f433 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.885483:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f433 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.885489:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f433 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.885495:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fe00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432608.885497:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f433 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.885512:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f433 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.885520:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:1.0:1787432608.885522:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787432608.885528:0:9020:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f43a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ee2 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.885538:0:9020:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f43a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ee2 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.885547:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f43a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ee2 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.885573:0:9020:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f43a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ee2 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432608.885583:0:9020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830443ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9020:1874258609446656:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787432608.885647:0:9020:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830380dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432608.898241:0:9020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830443ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9020:1874258609446656:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787432608.898278:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f433 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.898289:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f433 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.898334:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f4f7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.898372:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f4f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.898394:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f4f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.898407:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f4f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.898413:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f4f7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.898419:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f4f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.898425:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851a00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432608.898429:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f4f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.898436:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f4f7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.898449:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:1.0:1787432608.898452:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432608.898456:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f4f7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.898462:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f4f7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.898472:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.898485:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f4e9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.898491:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f4e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.898496:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432608.898499:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f4e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.898505:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f4e9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.898513:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:1.0:1787432608.898515:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787432608.898518:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f4e9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.898523:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f4e9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432608.898736:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:11428:x1874258588403840:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 49512us (49813us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787432608.898747:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 139 00000020:00080000:1.0:1787432608.898753:0:9020:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787432608.899459:0:13810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787432608.899467:0:13810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787432608.899932:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787432608.899954:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787432608.906680:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432608.907233:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588404352 00000100:00100000:0.0:1787432608.907245:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588404352 00000100:00100000:0.0:1787432608.907307:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 31 00000100:00100000:0.0:1787432608.907317:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:11428:x1874258588404352:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787432608.907602:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787432608.907635:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1787432608.907668:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f4fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.907686:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f4fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.907697:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f4fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.907706:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f4fe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.907712:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f4fe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.907718:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f4fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432608.907768:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787432608.907889:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:11428:x1874258588404352:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 571us (1217us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1787432608.907902:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 31 00000020:00080000:0.0:1787432608.907907:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787432608.908042:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432608.908059:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588404480 00000100:00100000:0.0:1787432608.908065:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588404480 00000100:00100000:0.0:1787432608.908089:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 32 00000100:00100000:0.0:1787432608.908096:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948411a1d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:11427:x1874258588404480:12345-192.168.204.24@tcp:49:lfs.0 00000100:00100000:0.0:1787432608.908212:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948411a1d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:11427:x1874258588404480:12345-192.168.204.24@tcp:49:lfs.0 Request processed in 112us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432608.908221:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 32 00010000:00010000:2.0:1787432608.908567:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432608.908576:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f4fe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.908583:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432608.908586:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f4fe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.908594:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f4fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.908607:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948420766c00) 00010000:00010000:2.0:1787432608.908610:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787432608.908614:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f4fe lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.908620:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f4fe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.908634:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432608.908636:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432608.908637:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432608.914846:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432608.915455:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588404736 00000100:00100000:2.0:1787432608.915469:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588404736 00000100:00100000:2.0:1787432608.915552:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 140 00000100:00100000:2.0:1787432608.915565:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:11427:x1874258588404736:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:2.0:1787432608.915772:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787432608.915867:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:11427:x1874258588404736:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 305us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432608.915874:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 140 00000100:00100000:0.0:1787432608.958407:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432608.958517:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588404864 00000100:00100000:2.0:1787432608.958527:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588404864 00000100:00100000:2.0:1787432608.958591:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 141 00000100:00100000:2.0:1787432608.958602:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:11431:x1874258588404864:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432608.958806:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432608.958829:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f505 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.958905:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f50c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.958922:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f50c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.958936:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f50c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.958951:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f513 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.958958:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.959031:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.959115:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f51a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.959126:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4edb expref: 22 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.959153:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f51a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.959290:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4edb expref: 22 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.959306:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4edb expref: 22 pid: 10165 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432608.959320:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874258609446784:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432608.959459:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432608.962001:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874258609446784:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432608.962033:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f51a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432608.962277:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432608.962361:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588405120 00000100:00100000:1.0:1787432608.962370:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588405120 00000100:00100000:1.0:1787432608.962437:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 33 00000100:00100000:1.0:1787432608.962447:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:6171:x1874258588405120:12345-192.168.204.24@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787432608.962728:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+24:6171:x1874258588405120:12345-192.168.204.24@tcp:35:ldlm_bl.0 Request processed in 282us (452us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787432608.962736:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 33 00000100:00100000:3.0:1787432608.967304:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432608.968293:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588405248 00000100:00100000:1.0:1787432608.968309:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588405248 00010000:00010000:1.0:1787432608.968358:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4edb expref: 24 pid: 10165 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432608.968420:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 80 00000100:00100000:1.0:1787432608.968431:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+24:2403:x1874258588405248:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432608.968448:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432608.968454:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4edb expref: 24 pid: 10165 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.968470:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4edb expref: 24 pid: 10165 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.968491:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f425 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4edb expref: 24 pid: 10165 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.968509:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:1.0:1787432608.968514:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f51a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.968524:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f51a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.968533:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f51a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432608.968581:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432608.968652:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:2403:x1874258588405248:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 222us (1361us total) trans 0 rc 0/0 00010000:00010000:2.0:1787432608.968757:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f51a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.968778:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f51a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432608.968838:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787432608.968842:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787432608.968862:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f51a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.968877:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f51a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.968899:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f50c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.968906:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f50c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.968912:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f50c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.968919:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ee00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432608.968923:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f50c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.968930:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f50c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.968941:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:2.0:1787432608.968944:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432608.968947:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f50c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.968953:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f50c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.968972:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.968979:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f513 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.968984:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f513 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.968995:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fa00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432608.968999:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f513 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.969004:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f513 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.969013:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff948420766500) 00010000:00010000:2.0:1787432608.969015:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432608.969018:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f513 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.969024:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f513 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.969063:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f505 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f1a expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.969077:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f51a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f1a expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432608.969084:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:2.0:1787432608.969086:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432608.969088:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85fe00, rc 0) 00000100:00100000:2.0:1787432608.969118:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:11431:x1874258588404864:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 10519us (10723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432608.969127:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 141 00000100:00100000:1.0:1787432608.969331:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 80 00010000:00010000:0.0:1787432608.971854:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432609.302912:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432609.302959:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432609.302983:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432609.303006:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432609.303022:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432609.303044:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432609.303072:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588405888 00000100:00100000:0.0:1787432609.303082:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588405888 00000100:00100000:0.0:1787432609.303142:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588405504 00000100:00100000:0.0:1787432609.303145:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588405504 00000100:00100000:0.0:1787432609.303159:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588406016 00000100:00100000:0.0:1787432609.303183:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588406016 00000100:00100000:0.0:1787432609.303222:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 318 00000100:00100000:0.0:1787432609.303233:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2403:x1874258588405888:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432609.303320:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2403:x1874258588405888:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 88us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432609.303328:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 318 00000100:00100000:0.0:1787432609.303347:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 319 00000100:00100000:0.0:1787432609.303353:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588405504:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432609.303393:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588405504:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 41us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432609.303399:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 319 00000100:00100000:0.0:1787432609.303412:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 320 00000100:00100000:0.0:1787432609.303419:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2403:x1874258588406016:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432609.303443:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2403:x1874258588406016:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432609.303449:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 320 00000100:00080000:0.0:1787432609.303473:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787432609.303478:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432609.303853:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588405632 00000100:00100000:2.0:1787432609.303867:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588405632 00000100:00100000:2.0:1787432609.303906:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588405760 00000100:00100000:2.0:1787432609.303909:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588405760 00000100:00100000:2.0:1787432609.303936:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 88 00000100:00100000:2.0:1787432609.303944:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588405632:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432609.303977:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2403:x1874258588405632:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 34us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432609.303984:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 88 00000100:00100000:2.0:1787432609.303999:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 89 00000100:00100000:2.0:1787432609.304006:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588405760:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432609.304029:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588405760:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432609.304034:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 89 00000100:00080000:2.0:1787432609.304056:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432609.304281:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588405376 00000100:00100000:3.0:1787432609.304289:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588405376 00000100:00100000:3.0:1787432609.304335:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 389 00000100:00100000:3.0:1787432609.304343:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:2403:x1874258588405376:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432609.304390:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:2403:x1874258588405376:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 47us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432609.304397:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 389 00000040:00080000:3.0:1787432609.936600:0:13810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787432609.936608:0:13810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787432609.936644:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787432609.936651:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787432609.936788:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304462300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13810:1874258609446912:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787432609.936894:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787432609.960000:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432609.960078:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588406144 00000100:00100000:1.0:1787432609.960088:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588406144 00000100:00100000:1.0:1787432609.960155:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 142 00000100:00100000:1.0:1787432609.960192:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:11442:x1874258588406144:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787432609.960232:0:9020:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787432609.960384:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:11442:x1874258588406144:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 219us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432609.960393:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 142 00000100:00100000:2.0:1787432609.960629:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304462300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13810:1874258609446912:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787432609.964315:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432609.964647:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588406400 00000100:00100000:0.0:1787432609.964657:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588406400 00000100:00100000:0.0:1787432609.964722:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 143 00000100:00100000:0.0:1787432609.964733:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:11442:x1874258588406400:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432609.964753:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432609.964774:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f521 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432609.965534:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f528 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432609.965552:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432609.965566:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432609.965577:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787432609.965688:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f521 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f21 expref: 25 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432609.965708:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f528 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f21 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432609.965717:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:0.0:1787432609.965720:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432609.965723:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304489400, rc 0) 00000100:00100000:0.0:1787432609.965790:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+24:11442:x1874258588406400:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1059us (1484us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787432609.965798:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 143 00000100:00100000:1.0:1787432609.974281:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432609.974437:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588406528 00000100:00100000:3.0:1787432609.974447:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588406528 00000100:00100000:3.0:1787432609.974507:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:3.0:1787432609.974518:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94841223c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+24:2403:x1874258588406528:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432609.974533:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432609.974559:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f528 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f21 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432609.974600:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:3.0:1787432609.974606:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432609.974661:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94841223c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:2403:x1874258588406528:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 144us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432609.974669:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:0.0:1787432609.975956:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432609.977883:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588406784 00000100:00100000:1.0:1787432609.977896:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588406784 00000100:00100000:0.0:1787432609.982393:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 144 00000100:00100000:0.0:1787432609.982409:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:11442:x1874258588406784:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787432609.982493:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563f536 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432609.982527:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563f536 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432609.982539:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563f536 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432609.983809:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563f536 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432609.983825:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563f536 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432609.983833:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563f536 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432609.983839:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432609.983843:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563f536 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432609.983849:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563f536 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432609.983863:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:0.0:1787432609.983866:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787432609.983870:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563f536 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432609.983876:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563f536 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432609.984010:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+24:11442:x1874258588406784:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 1600us (8054us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787432609.984031:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 144 00000040:00080000:2.0:1787432609.984417:0:13810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787432609.984422:0:13810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787432609.984919:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787432609.984929:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787432609.994012:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432609.994103:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588407040 00000100:00100000:1.0:1787432609.994113:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588407040 00000100:00100000:1.0:1787432609.994207:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 34 00000100:00100000:1.0:1787432609.994218:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+24:11442:x1874258588407040:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787432609.994441:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+25:11442:x1874258588407040:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 224us (439us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787432609.994449:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 34 00010000:00010000:1.0:1787432610.002571:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787432610.006681:0:14273:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787432610.006691:0:14273:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787432610.006721:0:14273:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787432610.006730:0:14273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787432610.173936:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432610.174215:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588407296 00000100:00100000:3.0:1787432610.174227:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588407296 00000100:00080000:2.0:1787432610.174380:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432610.174475:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 145 00000100:00100000:0.0:1787432610.174488:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+25:11455:x1874258588407296:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787432610.174513:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432610.174548:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f53d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f28 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432610.174695:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f544 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432610.174711:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f544 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432610.174723:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f544 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432610.174746:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787432610.174868:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f53d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f28 expref: 28 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432610.174887:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f544 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f28 expref: 27 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432610.174897:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:0.0:1787432610.174913:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787432610.174918:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304488000, rc 0) 00000100:00100000:0.0:1787432610.174999:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:11455:x1874258588407296:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 513us (1075us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787432610.175007:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 145 00000100:00100000:0.0:1787432610.178748:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432610.178856:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588407424 00000100:00100000:2.0:1787432610.178867:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588407424 00000100:00100000:2.0:1787432610.178922:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 146 00000100:00100000:2.0:1787432610.178932:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:11455:x1874258588407424:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:2.0:1787432610.179003:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f552 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432610.179033:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f552 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432610.179045:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f552 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432610.179092:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f552 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432610.179099:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f552 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432610.179106:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f552 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432610.179113:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ee00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432610.179119:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f552 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432610.179127:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f552 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432610.179138:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:2.0:1787432610.179142:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787432610.179146:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f552 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432610.179153:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f552 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432610.179273:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:11455:x1874258588407424:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 340us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432610.179288:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 146 00000100:00100000:2.0:1787432610.307289:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432610.307452:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588407552 00000100:00100000:3.0:1787432610.307466:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588407552 00000100:00100000:3.0:1787432610.307557:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 54 00000100:00100000:3.0:1787432610.307571:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2402:x1874258588407552:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:3.0:1787432610.307591:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432610.307616:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9723fb4/0xca72b3b33563f559 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f2f expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432610.307649:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8a0e9f, atime: 0x6a8a0e9f, ctime: 0x6a8a0e9f, blocks: 0x8 00010000:00010000:3.0:1787432610.307672:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1787432610.307676:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432610.307686:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9723fb4/0xca72b3b33563f559 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f2f expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432610.307706:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9723fb4/0xca72b3b33563f559 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f2f expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432610.307742:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303012200, rc 0) 00000100:00100000:3.0:1787432610.307819:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2402:x1874258588407552:12345-192.168.204.24@tcp:101:cat.0 Request processed in 251us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432610.307826:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 54 00000100:00080000:2.0:1787432610.308087:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432610.320732:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432610.323763:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588407680 00000100:00100000:0.0:1787432610.323779:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588407680 00002000:00100000:0.0:1787432610.324140:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff94830443c000 x1874258588407680/t0(0) o3->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:321/0 lens 488/0 e 0 to 0 dl 1787432621 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787432610.324152:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94830443c000 with x1874258588407680 ext(0->4095) 00002000:00010000:0.0:1787432610.324158:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94830443c000 00000100:00100000:0.0:1787432610.324279:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:0.0:1787432610.324290:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2403:x1874258588407680:12345-192.168.204.24@tcp:3:cat.0 00000100:00100000:0.0:1787432610.324771:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2403:x1874258588407680:12345-192.168.204.24@tcp:3:cat.0 Request processed in 482us (4049us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787432610.324779:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 3 00002000:00100000:0.0:1787432610.324785:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff94830443c000 x1874258588407680/t0(0) o3->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:321/0 lens 488/4536 e 0 to 0 dl 1787432621 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787432610.324793:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94830443c000 with x1874258588407680 ext(0->4095) 00002000:00010000:0.0:1787432610.324797:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94830443c000 00010000:00010000:2.0:1787432611.019604:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432611.787390:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432611.787416:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609447040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432611.787486:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432611.787551:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609447040 00000100:00100000:2.0:1787432611.787559:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609447040 00000100:00100000:2.0:1787432611.787604:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787432611.787614:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609447040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787432611.787657:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787432611.787702:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609447040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432611.787709:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787432611.787757:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609447040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432611.788960:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432611.788974:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609447168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432611.789019:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432611.789064:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609447168 00000100:00100000:0.0:1787432611.789076:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609447168 00000100:00100000:0.0:1787432611.789122:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787432611.789130:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609447168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787432611.789150:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432611.789212:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609447168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (192us total) trans 0 rc 0/0 00000100:00080000:1.0:1787432611.789450:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432611.789486:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609447168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432611.789525:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787432611.790978:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432611.790996:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609447296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432611.791069:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432611.791127:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609447296 00000100:00100000:3.0:1787432611.791134:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609447296 00000100:00100000:3.0:1787432611.791231:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787432611.791242:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609447296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432611.791265:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432611.791339:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609447296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432611.791347:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1787432611.791568:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432611.791615:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609447296:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787432612.058484:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432612.299544:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432612.299567:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609447424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432612.299636:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432612.299722:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609447424 00000100:00100000:0.0:1787432612.299730:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609447424 00000100:00100000:0.0:1787432612.299788:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787432612.299797:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1874258609447424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787432612.299827:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787432612.299872:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1874258609447424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432612.299879:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787432612.299923:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609447424:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787432612.300420:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432612.300447:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609447680:0@lo:400:kworker.0 00000100:00100000:3.0:1787432612.300487:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432612.300509:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609448192:0@lo:400:kworker.0 00000100:00100000:3.0:1787432612.300531:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432612.300567:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609448704:0@lo:400:kworker.0 00000100:00100000:3.0:1787432612.300605:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432612.300626:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787432612.300631:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609447808:0@lo:400:kworker.0 00000100:00100000:3.0:1787432612.300655:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432612.300855:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609447552:0@lo:400:kworker.0 00000100:00100000:1.0:1787432612.300890:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432612.300911:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609448064:0@lo:400:kworker.0 00000100:00100000:1.0:1787432612.300933:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432612.300948:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609448576:0@lo:400:kworker.0 00000100:00100000:1.0:1787432612.300969:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432612.300984:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787432612.300989:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609447936:0@lo:400:kworker.0 00000100:00100000:1.0:1787432612.301019:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432612.301037:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830391a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609448448:0@lo:400:kworker.0 00000100:00100000:1.0:1787432612.301060:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432612.301075:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609448960:0@lo:400:kworker.0 00000100:00100000:1.0:1787432612.301095:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432612.301119:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609447680 00000100:00100000:1.0:1787432612.301124:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609447680 00000100:00100000:1.0:1787432612.301185:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609448192 00000100:00100000:1.0:1787432612.301189:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609448192 00000100:00100000:1.0:1787432612.301209:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609448704 00000100:00100000:1.0:1787432612.301211:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609448704 00000100:00100000:1.0:1787432612.301223:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609447936 00000100:00100000:1.0:1787432612.301226:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609447936 00000100:00100000:1.0:1787432612.301239:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787432612.301246:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609447680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432612.301286:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609447680:12345-0@lo:400:kworker.0 Request processed in 41us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432612.301302:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787432612.301329:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787432612.301336:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f8cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609448192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432612.301365:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f8cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609448192:12345-0@lo:400:kworker.0 Request processed in 30us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432612.301371:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787432612.301381:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787432612.301387:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609448704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432612.301412:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609448704:12345-0@lo:400:kworker.0 Request processed in 26us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432612.301418:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787432612.301428:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787432612.301434:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609447936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432612.301461:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609447936:12345-0@lo:400:kworker.0 Request processed in 28us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432612.301466:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787432612.301498:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609447936:0@lo:400:kworker.0 00000100:00100000:1.0:1787432612.301545:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609448576 00000100:00100000:1.0:1787432612.301548:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609448576 00000100:00100000:1.0:1787432612.301573:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609448448 00000100:00100000:1.0:1787432612.301575:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609448448 00000100:00100000:1.0:1787432612.301585:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609448960 00000100:00100000:1.0:1787432612.301587:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609448960 00000100:00100000:1.0:1787432612.301602:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787432612.301608:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874258609448576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432612.301651:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874258609448576:12345-0@lo:400:kworker.0 Request processed in 43us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432612.301658:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787432612.301683:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787432612.301689:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609448448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432612.301715:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609448448:12345-0@lo:400:kworker.0 Request processed in 27us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432612.301721:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787432612.301731:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787432612.301737:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609448960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432612.301761:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609448960:12345-0@lo:400:kworker.0 Request processed in 25us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432612.301767:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787432612.301797:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830391a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609448448:0@lo:400:kworker.0 00000100:00100000:1.0:1787432612.301807:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609448960:0@lo:400:kworker.0 00000100:00100000:1.0:1787432612.301816:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609448576:0@lo:400:kworker.0 00000100:00080000:1.0:1787432612.301844:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432612.301848:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432612.302640:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609448320:0@lo:400:kworker.0 00000100:00100000:3.0:1787432612.302701:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432612.302731:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609448832:0@lo:400:kworker.0 00000100:00100000:3.0:1787432612.302755:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432612.302784:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609447680:0@lo:400:kworker.0 00000100:00100000:3.0:1787432612.302796:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609448192:0@lo:400:kworker.0 00000100:00100000:3.0:1787432612.302806:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609448704:0@lo:400:kworker.0 00000100:00100000:0.0:1787432612.302991:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609448320 00000100:00100000:0.0:1787432612.302996:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609448320 00000100:00100000:0.0:1787432612.303052:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609448832 00000100:00100000:0.0:1787432612.303055:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609448832 00000100:00100000:0.0:1787432612.303071:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787432612.303078:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609448320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432612.303128:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609448320:12345-0@lo:400:kworker.0 Request processed in 51us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432612.303148:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787432612.303187:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787432612.303195:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609448832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432612.303226:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609448832:12345-0@lo:400:kworker.0 Request processed in 33us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432612.303232:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00010000:00080000:0.0:1787432612.303277:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948304460a80 x1874258609448320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432612.303289:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609448320:0@lo:400:kworker.0 00010000:00080000:0.0:1787432612.303300:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f921180 x1874258609448832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432612.303309:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609448832:0@lo:400:kworker.0 00000100:00100000:2.0:1787432612.303544:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609447808 00000100:00100000:2.0:1787432612.303550:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609447808 00000100:00100000:2.0:1787432612.303577:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609448064 00000100:00100000:2.0:1787432612.303580:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609448064 00000100:00100000:2.0:1787432612.303593:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787432612.303599:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609447808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432612.303637:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609447808:12345-0@lo:400:kworker.0 Request processed in 39us (2981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432612.303642:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787432612.303655:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787432612.303764:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609448064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432612.303805:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609448064:12345-0@lo:400:kworker.0 Request processed in 137us (2871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432612.303811:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787432612.303831:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609447552 00000100:00100000:2.0:1787432612.303835:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609447552 00000100:00100000:2.0:1787432612.303861:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1787432612.303868:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3644:x1874258609447552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432612.303898:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3644:x1874258609447552:12345-0@lo:400:kworker.0 Request processed in 30us (3008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432612.303904:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1787432612.303948:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609447552:0@lo:400:kworker.0 00000100:00100000:2.0:1787432612.303958:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609448064:0@lo:400:kworker.0 00000100:00080000:3.0:1787432612.304131:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787432612.304248:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609447808:0@lo:400:kworker.0 00000100:00100000:3.0:1787432612.304369:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432612.304383:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609449088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432612.304418:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432612.304506:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609449088 00000100:00100000:1.0:1787432612.304511:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609449088 00000100:00100000:1.0:1787432612.304548:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787432612.304556:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609449088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787432612.304572:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787432612.304616:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609449088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432612.304631:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787432612.304710:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609449088:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1787432613.067413:0:13810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787432613.067424:0:13810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787432613.067521:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787432613.067532:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787432613.070615:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787432613.324788:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787432613.836014:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432613.839393:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609449216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432613.839481:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432613.839625:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609449216 00000100:00100000:2.0:1787432613.839634:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609449216 00000100:00100000:2.0:1787432613.839691:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787432613.839702:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609449216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787432613.839737:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787432613.843087:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609449216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3373us (3591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432613.843108:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787432613.843371:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609449216:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787432614.091465:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432614.423730:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432614.423771:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432614.423806:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432614.423835:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432614.423864:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432614.423879:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432614.423900:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432614.423985:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588407808 00000100:00100000:0.0:1787432614.423997:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588407808 00000100:00100000:0.0:1787432614.424058:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 391 00000100:00100000:0.0:1787432614.424068:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:2401:x1874258588407808:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432614.424141:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:2401:x1874258588407808:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 73us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432614.424159:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 391 00000100:00100000:0.0:1787432614.424239:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588408064 00000100:00100000:0.0:1787432614.424243:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588408064 00000100:00100000:0.0:1787432614.424291:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588408576 00000100:00100000:0.0:1787432614.424294:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588408576 00000100:00100000:0.0:1787432614.424321:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588407936 00000100:00100000:0.0:1787432614.424324:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588407936 00000100:00100000:0.0:1787432614.424339:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588408448 00000100:00100000:0.0:1787432614.424342:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588408448 00000100:00100000:0.0:1787432614.424356:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 327 00000100:00100000:0.0:1787432614.424363:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588408064:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432614.424396:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588408064:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 34us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432614.424403:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 327 00000100:00100000:0.0:1787432614.424415:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 328 00000100:00100000:0.0:1787432614.424422:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588408576:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432614.424445:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588408576:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432614.424452:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 328 00000100:00100000:0.0:1787432614.424464:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 329 00000100:00100000:0.0:1787432614.424471:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:2401:x1874258588407936:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432614.424493:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:2401:x1874258588407936:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432614.424499:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 329 00000100:00100000:0.0:1787432614.424510:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 330 00000100:00100000:0.0:1787432614.424516:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588408448:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432614.424540:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588408448:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432614.424546:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 330 00000100:00080000:0.0:1787432614.424563:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787432614.424572:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787432614.424889:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588408320 00000100:00100000:2.0:1787432614.424894:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588408320 00000100:00100000:2.0:1787432614.424942:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588408192 00000100:00100000:2.0:1787432614.424945:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588408192 00000100:00100000:2.0:1787432614.424980:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 93 00000100:00100000:2.0:1787432614.424988:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2401:x1874258588408320:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432614.425017:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2401:x1874258588408320:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432614.425024:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 93 00000100:00100000:2.0:1787432614.425038:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 94 00000100:00100000:2.0:1787432614.425045:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588408192:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432614.425066:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588408192:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432614.425072:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 94 00000100:00080000:0.0:1787432614.427191:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787432614.427201:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787432614.868879:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1787432614.869533:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1787432614.869565:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94830380d900 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787432614.869570:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9484335ae800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94830380d000 00000020:00080000:3.0:1787432614.869574:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9484335aef00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9484127e0000 00000020:00080000:3.0:1787432614.869593:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:3.0:1787432614.869612:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f4d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432614.869623:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f4d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432614.869631:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f4d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432614.869637:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432614.869642:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f4d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432614.869649:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f4d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432614.869665:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff948420766c00) 00010000:00010000:3.0:1787432614.869668:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432614.869681:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f4d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432614.869687:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f4d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787432614.869728:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787432614.869809:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1787432614.869902:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1787432614.869910:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:1.0:1787432615.120798:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432615.791364:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432615.791648:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588408704 00000100:00100000:0.0:1787432615.791660:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588408704 00000100:00100000:0.0:1787432615.791743:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 147 00000100:00100000:0.0:1787432615.791755:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+13:11116:x1874258588408704:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787432615.792083:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+13:11116:x1874258588408704:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 328us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432615.792093:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 147 00000100:00100000:1.0:1787432615.795915:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432615.796398:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588408832 00000100:00100000:0.0:1787432615.796410:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588408832 00000100:00100000:0.0:1787432615.796475:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 148 00000100:00100000:0.0:1787432615.796610:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:11116:x1874258588408832:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787432615.796834:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:11116:x1874258588408832:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 350us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432615.796843:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 148 00000100:00100000:3.0:1787432615.825200:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432615.825477:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588409088 00000100:00100000:1.0:1787432615.825487:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588409088 00000100:00100000:1.0:1787432615.825671:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 35 00000100:00100000:1.0:1787432615.825683:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+13:11116:x1874258588409088:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787432615.825922:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:11116:x1874258588409088:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 240us (768us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787432615.825930:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 35 00010000:00010000:1.0:1787432616.141604:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432616.182134:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432616.182295:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588409216 00000100:00100000:0.0:1787432616.182304:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588409216 00000100:00100000:0.0:1787432616.182380:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 149 00000100:00100000:0.0:1787432616.182392:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:11913:x1874258588409216:12345-192.168.204.24@tcp:101:lsof.0 00010000:00010000:0.0:1787432616.182411:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432616.182431:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489200/0xca72b3b33563f560 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f36 expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432616.182490:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489800/0xca72b3b33563f567 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432616.182519:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489800/0xca72b3b33563f567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432616.182529:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489800/0xca72b3b33563f567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432616.182574:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787432616.182578:0:9020:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787432616.182614:0:9020:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948304489800/0xca72b3b33563f567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432616.182639:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489200/0xca72b3b33563f560 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f36 expref: 7 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432616.182657:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489800/0xca72b3b33563f567 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f36 expref: 6 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432616.182665:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766b00) 00010000:00010000:0.0:1787432616.182668:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787432616.182671:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304489800, rc 0) 00000100:00100000:0.0:1787432616.182740:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:11913:x1874258588409216:12345-192.168.204.24@tcp:101:lsof.0 Request processed in 351us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432616.182747:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 149 00000100:00080000:3.0:1787432616.183114:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432616.907786:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432616.907811:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609449472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787432616.908146:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609449344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432616.909131:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432616.909531:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432616.909735:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830383a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609449600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432616.909767:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432616.909806:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609449472 00000100:00100000:1.0:1787432616.909813:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609449472 00000100:00100000:3.0:1787432616.910574:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609449344 00000100:00100000:3.0:1787432616.910582:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609449344 00000100:00100000:3.0:1787432616.910624:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787432616.910634:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830383a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609449344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787432616.910669:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787432616.910729:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830383a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609449344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432616.910737:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787432616.910910:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609449344:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787432616.910947:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432616.921537:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609449600 00000100:00100000:1.0:1787432616.921551:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609449600 00000100:00080000:3.0:1787432616.924144:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432616.929784:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787432616.929842:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609449472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787432616.929884:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432616.929998:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609449472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 199us (20867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432616.930023:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787432616.930048:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787432616.930056:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609449600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432616.930070:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432616.930101:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609449600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (20333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432616.930106:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787432616.930541:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1787432616.930547:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff948304460380, transno 4294967305 00000100:00100000:3.0:1787432616.930566:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830383a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609449600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432616.930585:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609449472:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787432617.164612:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432617.419547:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609449856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432617.419629:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432617.423490:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609449728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432617.423547:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609449984:0@lo:400:kworker.0 00000100:00100000:3.0:1787432617.427464:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432617.427534:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432617.427549:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435ba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609450112:0@lo:400:kworker.0 00000100:00100000:3.0:1787432617.428015:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432617.428067:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609449984 00000100:00100000:3.0:1787432617.428076:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609449984 00000100:00100000:3.0:1787432617.428126:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1787432617.428135:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609449984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432617.428226:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609449984:12345-0@lo:400:kworker.0 Request processed in 81us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432617.428234:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1787432617.428814:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609449984:0@lo:400:kworker.0 00000100:00100000:3.0:1787432617.428878:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609449856 00000100:00100000:3.0:1787432617.428883:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609449856 00000100:00080000:3.0:1787432617.428910:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432617.428938:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787432617.428945:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609449856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787432617.428970:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787432617.429012:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609449856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (9393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432617.429019:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787432617.429051:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609450112 00000100:00100000:3.0:1787432617.429055:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609450112 00000100:00100000:3.0:1787432617.429084:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787432617.429090:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830383a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609450112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432617.429130:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830383a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609450112:12345-0@lo:400:kworker.0 Request processed in 39us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432617.429137:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787432617.429197:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435ba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609450112:0@lo:400:kworker.0 00000100:00100000:2.0:1787432617.430577:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609450368:0@lo:400:kworker.0 00000100:00100000:2.0:1787432617.430638:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432617.430700:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1787432617.430707:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff948303a9d180, transno 4294967311 00000004:00080000:2.0:1787432617.430721:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1787432617.430757:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609449856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432617.431043:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609450624:0@lo:400:kworker.0 00000100:00100000:1.0:1787432617.431082:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432617.431248:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609450368 00000100:00100000:3.0:1787432617.431254:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609450368 00000100:00100000:3.0:1787432617.431299:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787432617.431309:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609450368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432617.431401:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609451136:0@lo:400:kworker.0 00000100:00100000:1.0:1787432617.431437:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432617.431457:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787432617.431463:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830391a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609450496:0@lo:400:kworker.0 00000100:00100000:1.0:1787432617.431486:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432617.431506:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609451008:0@lo:400:kworker.0 00000100:00100000:1.0:1787432617.431527:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432617.431555:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609450624 00000100:00100000:1.0:1787432617.431560:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609450624 00000100:00100000:1.0:1787432617.431595:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609450496 00000100:00100000:1.0:1787432617.431597:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609450496 00000100:00100000:1.0:1787432617.431613:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609451008 00000100:00100000:1.0:1787432617.431616:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609451008 00000100:00100000:1.0:1787432617.431633:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787432617.431639:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609450624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432617.431675:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609450624:12345-0@lo:400:kworker.0 Request processed in 36us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432617.431682:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787432617.431697:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1787432617.431703:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609450496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432617.431729:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609450496:12345-0@lo:400:kworker.0 Request processed in 27us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432617.431736:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1787432617.431748:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787432617.431754:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609451008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432617.431782:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609451008:12345-0@lo:400:kworker.0 Request processed in 28us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432617.431799:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00080000:1.0:1787432617.431818:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432617.431822:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432617.431850:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830391a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609450496:0@lo:400:kworker.0 00010000:00080000:1.0:1787432617.431862:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948304462a00 x1874258609451008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432617.431872:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609451008:0@lo:400:kworker.0 00010000:00080000:1.0:1787432617.431881:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948304460380 x1874258609450624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432617.431889:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609450624:0@lo:400:kworker.0 00000100:00100000:2.0:1787432617.432070:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609451136 00000100:00100000:2.0:1787432617.432075:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609451136 00000100:00100000:2.0:1787432617.432132:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787432617.432139:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609451136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432617.432198:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609451136:12345-0@lo:400:kworker.0 Request processed in 59us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432617.432204:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787432617.432249:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609451136:0@lo:400:kworker.0 00000100:00100000:2.0:1787432617.432267:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609450880:0@lo:400:kworker.0 00000100:00100000:2.0:1787432617.432292:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432617.432309:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432617.432315:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609450752:0@lo:400:kworker.0 00000100:00100000:2.0:1787432617.432334:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432617.432357:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609450752 00000100:00100000:2.0:1787432617.432361:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609450752 00000100:00100000:2.0:1787432617.432385:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787432617.432392:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609450752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432617.432426:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609450752:12345-0@lo:400:kworker.0 Request processed in 34us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432617.432432:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787432617.432449:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609450880 00000100:00100000:2.0:1787432617.432453:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609450880 00000100:00100000:2.0:1787432617.432477:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1787432617.432484:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609450880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432617.432512:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609450880:12345-0@lo:400:kworker.0 Request processed in 30us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432617.432530:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1787432617.432559:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609450752:0@lo:400:kworker.0 00000100:00100000:2.0:1787432617.432569:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609450880:0@lo:400:kworker.0 00000100:00080000:1.0:1787432617.432800:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432617.432804:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432617.433655:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609450368:12345-0@lo:400:kworker.0 Request processed in 2342us (3013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432617.433666:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787432617.433749:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609450368:0@lo:400:kworker.0 00000100:00100000:0.0:1787432617.433940:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432617.433992:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609450240:0@lo:400:kworker.0 00000100:00100000:0.0:1787432617.434030:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432617.434185:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609450240 00000100:00100000:1.0:1787432617.434192:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609450240 00000100:00100000:1.0:1787432617.434248:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787432617.434258:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609450240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432617.434296:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609450240:12345-0@lo:400:kworker.0 Request processed in 40us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432617.434302:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787432617.434411:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609450240:0@lo:400:kworker.0 00000100:00100000:2.0:1787432617.434472:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609449728 00000100:00100000:2.0:1787432617.434477:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609449728 00000100:00100000:2.0:1787432617.434510:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787432617.434518:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609449728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787432617.434533:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787432617.434584:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609449728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432617.434590:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787432617.434654:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609449728:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787432618.189446:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432618.962720:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609451264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432618.962803:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432618.963742:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609451264 00000100:00100000:2.0:1787432618.963753:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609451264 00000100:00100000:2.0:1787432618.963818:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787432618.963829:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609451264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787432618.963867:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787432618.963935:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609451264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432618.963942:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787432618.964037:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609451264:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787432619.214433:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432619.548990:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432619.549037:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432619.549072:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432619.549108:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432619.549127:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432619.549221:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432619.549248:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432619.549281:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588409856 00000100:00100000:2.0:1787432619.549292:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588409856 00000100:00100000:2.0:1787432619.549351:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588409728 00000100:00100000:2.0:1787432619.549354:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588409728 00000100:00100000:2.0:1787432619.549380:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 97 00000100:00100000:2.0:1787432619.549391:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2400:x1874258588409856:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432619.549476:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2400:x1874258588409856:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 87us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432619.549485:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 97 00000100:00100000:2.0:1787432619.549504:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 98 00000100:00100000:2.0:1787432619.549510:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588409728:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432619.549533:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588409728:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432619.549539:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 98 00000100:00100000:2.0:1787432619.549691:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588409600 00000100:00100000:2.0:1787432619.549696:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588409600 00000100:00100000:0.0:1787432619.550053:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588410112 00000100:00100000:0.0:1787432619.550059:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588410112 00000100:00100000:0.0:1787432619.550096:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588409472 00000100:00100000:0.0:1787432619.550099:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588409472 00000100:00100000:0.0:1787432619.550112:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588409984 00000100:00100000:0.0:1787432619.550115:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588409984 00000100:00100000:0.0:1787432619.550143:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 337 00000100:00100000:0.0:1787432619.550153:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588410112:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432619.550237:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588410112:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 86us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432619.550245:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 337 00000100:00100000:0.0:1787432619.550259:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 338 00000100:00100000:0.0:1787432619.550266:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:2400:x1874258588409472:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432619.550295:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:2400:x1874258588409472:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432619.550301:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 338 00000100:00100000:0.0:1787432619.550313:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 339 00000100:00100000:0.0:1787432619.550319:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2400:x1874258588409984:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432619.550340:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2400:x1874258588409984:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 21us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432619.550345:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 339 00000100:00080000:0.0:1787432619.550368:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787432619.550372:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787432619.550375:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787432619.550378:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432619.550662:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 340 00000100:00100000:2.0:1787432619.550669:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588409600:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432619.551771:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588409344 00000100:00100000:3.0:1787432619.551783:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588409344 00000100:00100000:3.0:1787432619.551841:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 393 00000100:00100000:3.0:1787432619.551850:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588409344:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432619.551914:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588409344:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 65us (2937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432619.551921:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 393 00000100:00100000:2.0:1787432619.552853:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588409600:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (1660us total) trans 0 rc 0/0 00000100:00080000:0.0:1787432619.552959:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787432619.553005:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 340 00010000:00010000:0.0:1787432620.241272:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787432620.723952:0:14470:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 17:03:38 (1787432618) 00000001:00080000:3.0:1787432621.021877:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1787432621.021892:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1787432621.021947:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787432621.021960:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1787432621.259545:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432622.027848:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830383b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609451392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432622.027934:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432622.028122:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609451392 00000100:00100000:3.0:1787432622.028142:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609451392 00000100:00100000:3.0:1787432622.028221:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787432622.028232:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609451392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432622.028260:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432622.028305:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609451392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432622.028313:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787432622.028473:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609451520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787432622.028514:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432622.028650:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609451520 00000100:00100000:0.0:1787432622.028655:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609451520 00000100:00100000:0.0:1787432622.028689:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787432622.028696:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609451520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787432622.028715:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432622.028760:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609451520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432622.028766:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787432622.028804:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609451520:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787432622.028967:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432622.029002:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830383b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609451392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432622.029203:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609451648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432622.029241:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432622.029350:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609451648 00000100:00100000:3.0:1787432622.029354:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609451648 00000100:00100000:3.0:1787432622.029389:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787432622.029397:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609451648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787432622.029419:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787432622.029459:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609451648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432622.029465:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787432622.029540:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609451648:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787432622.283658:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432622.539460:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609451776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432622.539535:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432622.539630:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609451776 00000100:00100000:0.0:1787432622.539638:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609451776 00000100:00100000:0.0:1787432622.539692:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787432622.539703:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609451776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787432622.539732:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787432622.539784:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609451776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432622.539792:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787432622.539848:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609451776:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787432622.540353:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432622.540367:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609451904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787432622.540403:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432622.540441:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609451904 00000100:00100000:1.0:1787432622.540446:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609451904 00000100:00100000:1.0:1787432622.540480:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787432622.540487:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609451904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787432622.540499:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787432622.540532:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609451904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432622.540539:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1787432622.540554:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432622.540576:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609451904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432622.540833:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609452288:0@lo:400:kworker.0 00000100:00100000:0.0:1787432622.540864:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432622.540892:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609452800:0@lo:400:kworker.0 00000100:00100000:0.0:1787432622.540914:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432622.540930:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787432622.540936:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609452416:0@lo:400:kworker.0 00000100:00100000:0.0:1787432622.540962:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432622.540978:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609452928:0@lo:400:kworker.0 00000100:00100000:0.0:1787432622.540997:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432622.541059:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609452288 00000100:00100000:2.0:1787432622.541064:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609452288 00000100:00100000:2.0:1787432622.541108:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609452800 00000100:00100000:2.0:1787432622.541111:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609452800 00000100:00100000:2.0:1787432622.541145:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609452928 00000100:00100000:2.0:1787432622.541148:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609452928 00000100:00100000:2.0:1787432622.541182:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1787432622.541190:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609452288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432622.541231:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609452288:12345-0@lo:400:kworker.0 Request processed in 43us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432622.541237:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1787432622.541252:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1787432622.541257:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609452800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432622.541284:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609452800:12345-0@lo:400:kworker.0 Request processed in 27us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432622.541290:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1787432622.541301:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1787432622.541307:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609452928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432622.541334:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609452928:12345-0@lo:400:kworker.0 Request processed in 28us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432622.541340:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00010000:00080000:0.0:1787432622.541536:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948433653b80 x1874258609452928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432622.541566:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609452928:0@lo:400:kworker.0 00000100:00100000:0.0:1787432622.541577:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609452288:0@lo:400:kworker.0 00000100:00100000:0.0:1787432622.541584:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948433651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609452800:0@lo:400:kworker.0 00000100:00100000:1.0:1787432622.541733:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609452416 00000100:00100000:1.0:1787432622.541738:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609452416 00000100:00100000:1.0:1787432622.541772:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787432622.541780:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609452416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432622.541826:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609452416:12345-0@lo:400:kworker.0 Request processed in 46us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432622.541832:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:1.0:1787432622.541852:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432622.541856:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432622.541866:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830443f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609452160:0@lo:400:kworker.0 00000100:00100000:1.0:1787432622.541900:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432622.541926:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609452672:0@lo:400:kworker.0 00000100:00100000:1.0:1787432622.541946:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432622.541969:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787432622.541975:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609452032:0@lo:400:kworker.0 00000100:00100000:1.0:1787432622.541999:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432622.542024:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609452544:0@lo:400:kworker.0 00000100:00100000:1.0:1787432622.542044:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432622.542213:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609452160 00000100:00100000:3.0:1787432622.542218:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609452160 00000100:00100000:3.0:1787432622.542246:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609452672 00000100:00100000:3.0:1787432622.542249:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609452672 00000100:00100000:3.0:1787432622.542270:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609452544 00000100:00100000:3.0:1787432622.542273:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609452544 00000100:00100000:3.0:1787432622.542286:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1787432622.542293:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609452160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432622.542331:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609452160:12345-0@lo:400:kworker.0 Request processed in 39us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432622.542338:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1787432622.542350:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787432622.542356:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609452672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432622.542382:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609452672:12345-0@lo:400:kworker.0 Request processed in 27us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432622.542388:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787432622.542399:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787432622.542413:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609452544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432622.542441:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609452544:12345-0@lo:400:kworker.0 Request processed in 30us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432622.542446:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00080000:3.0:1787432622.542463:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432622.542465:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787432622.542551:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609452416:0@lo:400:kworker.0 00000100:00100000:0.0:1787432622.542585:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609452544:0@lo:400:kworker.0 00000100:00100000:0.0:1787432622.542594:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830443f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609452160:0@lo:400:kworker.0 00010000:00080000:0.0:1787432622.542603:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f928700 x1874258609452672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432622.542612:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609452672:0@lo:400:kworker.0 00000100:00100000:1.0:1787432622.542880:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609452032 00000100:00100000:1.0:1787432622.542886:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609452032 00000100:00100000:1.0:1787432622.542925:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1787432622.542933:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3644:x1874258609452032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432622.542984:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3644:x1874258609452032:12345-0@lo:400:kworker.0 Request processed in 51us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432622.542991:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787432622.543807:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609452032:0@lo:400:kworker.0 00000100:00100000:3.0:1787432622.812735:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432622.813208:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588410368 00000100:00100000:0.0:1787432622.813219:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588410368 00000100:00100000:0.0:1787432622.813300:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 150 00000100:00100000:0.0:1787432622.813311:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+13:12180:x1874258588410368:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432622.813332:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432622.813352:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f56e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f3d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.813428:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f575 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.813443:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f575 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.813472:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f575 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.813502:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f57c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.813510:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f57c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.813516:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f57c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.813626:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f583 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.813634:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f583 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.813641:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f583 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432622.813650:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787432622.813752:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f575 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.813760:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f575 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.813767:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f575 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.813772:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432622.813783:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f575 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.813791:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f575 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.813999:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94841318b900) 00010000:00010000:0.0:1787432622.814003:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432622.814007:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f575 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.814014:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f575 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.814028:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f57c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.814034:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f57c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.814040:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f57c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.814045:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432622.814048:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f57c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.814054:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f57c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.814061:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff948411a7a300) 00010000:00010000:0.0:1787432622.814257:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432622.814267:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f57c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.814274:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f57c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787432622.814564:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787432622.816364:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f56e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f3d expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.816393:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f583 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f3d expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432622.816403:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94841318b400) 00010000:00010000:0.0:1787432622.816407:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432622.816410:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304488800, rc 0) 00000100:00100000:0.0:1787432622.816627:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:12180:x1874258588410368:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 3315us (3900us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787432622.816637:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 150 00000100:00100000:1.0:1787432622.841403:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432622.841876:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432622.842099:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588410496 00000100:00100000:2.0:1787432622.842117:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588410496 00000100:00100000:2.0:1787432622.842216:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 10 00000100:00100000:2.0:1787432622.842226:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830383b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:2401:x1874258588410496:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432622.842242:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432622.842268:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f583 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f3d expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432622.842304:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94841318b400) 00010000:00010000:2.0:1787432622.842309:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432622.842371:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830383b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:2401:x1874258588410496:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 146us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432622.842378:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 10 00000100:00100000:3.0:1787432622.842906:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588410624 00000100:00100000:3.0:1787432622.842912:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588410624 00000100:00100000:3.0:1787432622.842953:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 151 00000100:00100000:3.0:1787432622.842961:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:12180:x1874258588410624:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787432622.843026:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:12180:x1874258588410624:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 66us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432622.843032:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 151 00000100:00100000:3.0:1787432622.868825:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432622.874322:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588410752 00000100:00100000:2.0:1787432622.874340:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588410752 00000100:00100000:2.0:1787432622.874444:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 152 00000100:00100000:2.0:1787432622.874455:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948302765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:12180:x1874258588410752:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787432622.874782:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948302765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:12180:x1874258588410752:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 327us (5976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432622.874790:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 152 00000100:00080000:3.0:1787432622.874794:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1787432623.308108:0:13810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787432623.308123:0:13810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787432623.308268:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787432623.308277:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787432623.314526:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787432623.565830:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787432624.075768:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432624.075794:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609453056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432624.075870:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432624.075936:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609453056 00000100:00100000:0.0:1787432624.075944:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609453056 00000100:00100000:0.0:1787432624.075992:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787432624.076001:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609453056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432624.076635:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432624.076857:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609453056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 854us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432624.076867:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787432624.081031:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609453056:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787432624.331538:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432624.661874:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432624.661929:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432624.661966:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432624.662000:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432624.662037:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432624.662313:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588411008 00000100:00100000:3.0:1787432624.662325:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588411008 00000100:00100000:3.0:1787432624.662384:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588411136 00000100:00100000:3.0:1787432624.662388:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588411136 00000100:00100000:3.0:1787432624.662416:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588411648 00000100:00100000:3.0:1787432624.662420:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588411648 00000100:00100000:3.0:1787432624.662440:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 347 00000100:00100000:3.0:1787432624.662449:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:2401:x1874258588411008:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432624.662543:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:2401:x1874258588411008:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 94us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432624.662551:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 347 00000100:00100000:3.0:1787432624.662568:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 348 00000100:00100000:3.0:1787432624.662575:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588411136:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432624.662602:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588411136:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432624.662608:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 348 00000100:00100000:3.0:1787432624.662620:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 349 00000100:00100000:3.0:1787432624.662627:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588411648:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432624.662652:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588411648:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432624.662658:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 349 00000100:00080000:3.0:1787432624.662674:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432624.662678:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432624.662706:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432624.662825:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588411392 00000100:00100000:2.0:1787432624.662832:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588411392 00000100:00100000:2.0:1787432624.662864:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588411264 00000100:00100000:2.0:1787432624.662867:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588411264 00000100:00100000:2.0:1787432624.662903:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 99 00000100:00100000:2.0:1787432624.662910:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2400:x1874258588411392:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432624.662930:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432624.662981:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588411520 00000100:00100000:3.0:1787432624.662985:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588411520 00000100:00100000:3.0:1787432624.663302:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 350 00000100:00100000:3.0:1787432624.663310:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2401:x1874258588411520:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432624.663343:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2401:x1874258588411520:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 34us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432624.663349:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 350 00000100:00100000:2.0:1787432624.663738:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2400:x1874258588411392:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 826us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432624.663745:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 99 00000100:00100000:2.0:1787432624.663760:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 100 00000100:00100000:2.0:1787432624.663767:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588411264:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432624.663796:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588411264:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432624.663809:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 100 00000100:00080000:2.0:1787432624.663842:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787432624.663846:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787432624.663847:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432624.663857:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588410880 00000100:00100000:1.0:1787432624.663862:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588410880 00000100:00100000:1.0:1787432624.663892:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 395 00000100:00100000:1.0:1787432624.663899:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588410880:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432624.663926:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588410880:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (1996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432624.663932:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 395 00010000:00010000:2.0:1787432625.357285:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432625.725760:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432625.725984:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588411776 00000100:00100000:2.0:1787432625.725998:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588411776 00000100:00100000:2.0:1787432625.726085:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 153 00000100:00100000:2.0:1787432625.726098:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:12224:x1874258588411776:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432625.726125:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432625.726155:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f591 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f44 expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726259:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f598 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726278:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f598 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726291:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f598 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726308:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f59f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726315:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f59f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726322:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f59f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726410:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f598 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726418:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f598 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726425:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f598 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726430:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432625.726435:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f598 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726443:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f598 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726457:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766b00) 00010000:00010000:2.0:1787432625.726460:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432625.726464:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f598 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726470:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f598 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726482:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f59f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726489:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f59f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726495:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f59f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726569:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432625.726573:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f59f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726579:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f59f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726587:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff948420766700) 00010000:00010000:2.0:1787432625.726590:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432625.726592:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f59f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726598:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f59f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726637:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f591 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f44 expref: 15 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726646:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766b00) 00010000:00010000:2.0:1787432625.726649:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432625.726653:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f591 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f44 expref: 15 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.726661:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85ea00, rc 0) 00000100:00100000:2.0:1787432625.726723:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:12224:x1874258588411776:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 627us (973us total) trans 0 rc 301/301 00000100:00100000:2.0:1787432625.726731:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 153 00000100:00100000:2.0:1787432625.731141:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432625.731263:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588412032 00000100:00100000:3.0:1787432625.731274:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588412032 00000100:00100000:3.0:1787432625.731339:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 154 00000100:00100000:3.0:1787432625.731351:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+14:12224:x1874258588412032:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:3.0:1787432625.732392:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432625.732429:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563eee5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d68 expref: 14 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.732464:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766b00) 00010000:00010000:3.0:1787432625.732470:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432625.732556:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f5a6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.732570:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489800/0xca72b3b33563f567 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f36 expref: 5 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.732579:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f5a6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.732616:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948304489800/0xca72b3b33563f567 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f36 expref: 5 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.732630:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489800/0xca72b3b33563f567 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f36 expref: 5 pid: 9020 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432625.732644:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405942300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874258609453184:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432625.732741:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484122bf300 going to sleep for 11 seconds 00000100:00100000:0.0:1787432625.738631:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432625.738774:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588412160 00000100:00100000:2.0:1787432625.738784:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588412160 00010000:00010000:2.0:1787432625.738833:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489800/0xca72b3b33563f567 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f36 expref: 6 pid: 9020 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432625.738882:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 81 00000100:00100000:2.0:1787432625.738893:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f928700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2403:x1874258588412160:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432625.738912:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432625.738920:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948304489800/0xca72b3b33563f567 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f36 expref: 6 pid: 9020 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.738935:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948304489800/0xca72b3b33563f567 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f36 expref: 6 pid: 9020 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.738962:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766b00) 00010000:00010000:2.0:1787432625.738967:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f5a6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.738979:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f5a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.738987:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f5a6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.739011:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432625.739089:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f928700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2403:x1874258588412160:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 197us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432625.739097:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 81 00010000:00010000:3.0:1787432625.739368:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489800/0xca72b3b33563f567 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f36 expref: 5 pid: 9020 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432625.739459:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405942300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6514:1874258609453184:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432625.739482:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f5a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.739492:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f5a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.739507:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f5a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.739531:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f5ad lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.739541:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f5ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.739550:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f5ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.740260:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f5b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.740273:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f5b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.740282:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f5b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432625.740300:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020320ec8 reply state 000000007a5a20e3 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f5b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.740320:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f5b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.740329:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:3.0:1787432625.740332:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787432625.740337:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787432625.740344:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787432625.740352:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f5a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.740359:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f5a6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.740366:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f5a6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.740372:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432625.740377:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f5a6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.740385:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f5a6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.740393:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948420766b00) 00010000:00010000:3.0:1787432625.740396:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432625.740399:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f5a6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.740404:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f5a6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432625.740432:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020320ec8 reply state 000000007a5a20e3 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f5ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.740441:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f5ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.740447:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9483026f7800) 00010000:00010000:3.0:1787432625.740448:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787432625.740450:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787432625.740545:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:12224:x1874258588412032:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 9195us (9417us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787432625.740554:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 154 00000100:00100000:0.0:1787432625.837944:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432625.838402:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588412288 00000100:00100000:1.0:1787432625.838421:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588412288 00000100:00100000:1.0:1787432625.838477:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 155 00000100:00100000:1.0:1787432625.838489:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+15:12232:x1874258588412288:12345-192.168.204.24@tcp:101:lctl.0 00010000:00010000:1.0:1787432625.838515:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432625.838539:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f5bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f4b expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432625.838608:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f5c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432625.838622:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432625.838633:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432625.838679:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787432625.838684:0:10165:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432625.838707:0:10165:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432625.838744:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f5bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f4b expref: 17 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432625.838764:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f5c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f4b expref: 16 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432625.838774:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9483032ad500) 00010000:00010000:1.0:1787432625.838777:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432625.838781:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850800, rc 0) 00000100:00100000:1.0:1787432625.838842:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:12232:x1874258588412288:12345-192.168.204.24@tcp:101:lctl.0 Request processed in 354us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432625.838849:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 155 00000100:00100000:2.0:1787432625.929082:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432625.929280:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588412416 00000100:00100000:0.0:1787432625.929291:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588412416 00000100:00100000:0.0:1787432625.929353:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 156 00000100:00100000:0.0:1787432625.929364:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+16:12238:x1874258588412416:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787432625.929401:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432625.929423:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489c00/0xca72b3b33563f5c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f52 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929495:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489200/0xca72b3b33563f5d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929512:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489200/0xca72b3b33563f5d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929525:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489200/0xca72b3b33563f5d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929539:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488600/0xca72b3b33563f5d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929554:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488600/0xca72b3b33563f5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929561:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488600/0xca72b3b33563f5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929649:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489800/0xca72b3b33563f5de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929658:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489800/0xca72b3b33563f5de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929664:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489800/0xca72b3b33563f5de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432625.929700:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787432625.929703:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787432625.929734:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948304489800/0xca72b3b33563f5de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929746:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489200/0xca72b3b33563f5d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929753:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489200/0xca72b3b33563f5d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929760:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304489200/0xca72b3b33563f5d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929766:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432625.929770:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489200/0xca72b3b33563f5d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929785:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489200/0xca72b3b33563f5d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929797:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9483032ad500) 00010000:00010000:0.0:1787432625.929800:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432625.929805:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304489200/0xca72b3b33563f5d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929810:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489200/0xca72b3b33563f5d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929825:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488600/0xca72b3b33563f5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929831:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304488600/0xca72b3b33563f5d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929837:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304488600/0xca72b3b33563f5d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929842:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432625.929845:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488600/0xca72b3b33563f5d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929851:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488600/0xca72b3b33563f5d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929858:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9483026f7800) 00010000:00010000:0.0:1787432625.929861:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432625.929863:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304488600/0xca72b3b33563f5d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929879:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488600/0xca72b3b33563f5d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929906:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489c00/0xca72b3b33563f5c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f52 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929920:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489800/0xca72b3b33563f5de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f52 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.929927:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:0.0:1787432625.929930:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787432625.929933:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304489800, rc 0) 00000100:00100000:0.0:1787432625.930021:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+17:12238:x1874258588412416:12345-192.168.204.24@tcp:101:bash.0 Request processed in 658us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432625.930028:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 156 00000100:00100000:2.0:1787432625.935421:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432625.935496:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588412672 00000100:00100000:3.0:1787432625.935507:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588412672 00000100:00100000:3.0:1787432625.935595:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 157 00000100:00100000:3.0:1787432625.935607:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+17:12238:x1874258588412672:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787432625.935628:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432625.935651:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f5e5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f59 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.935762:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f5ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.935777:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f5ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.935788:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f5ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.935866:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f5f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.935874:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.935880:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787432625.936277:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1787432625.936431:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f5fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.936440:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f5fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.936447:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f5fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.936476:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f5ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.936483:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f5ec lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.936489:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f5ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.936494:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303012000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432625.936498:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f5ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.936516:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f5ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.936530:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:3.0:1787432625.936532:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432625.936536:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f5ec lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.936542:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f5ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432625.936556:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008c65d0e reply state 00000000d6b47a00 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.936566:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f5f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.936572:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9483026f7900) 00010000:00010000:3.0:1787432625.936574:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787432625.936577:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787432625.936609:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f5e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f59 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.936623:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f5fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f59 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432625.936631:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7500) 00010000:00010000:3.0:1787432625.936633:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432625.936636:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303013e00, rc 0) 00000100:00100000:3.0:1787432625.936710:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:12238:x1874258588412672:12345-192.168.204.24@tcp:101:bash.0 Request processed in 1105us (1301us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1787432625.936725:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 157 00000100:00100000:2.0:1787432625.952602:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432625.952723:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588412800 00000100:00100000:0.0:1787432625.952734:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588412800 00000100:00100000:0.0:1787432625.952900:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 55 00000100:00100000:0.0:1787432625.952912:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588412800:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787432625.952930:0:8806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432625.952953:0:8806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013439573/0xca72b3b33563f608 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f60 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787432625.952981:0:8806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787432625.953002:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=437s v=(0 0) 00010000:00010000:0.0:1787432625.953007:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432625.953035:0:8806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013439573/0xca72b3b33563f608 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f60 expref: 6 pid: 8806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.953141:0:8806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013439573/0xca72b3b33563f608 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f60 expref: 6 pid: 8806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.953157:0:8806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304489c00, rc 0) 00000100:00100000:0.0:1787432625.953504:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2401:x1874258588412800:12345-192.168.204.24@tcp:101:bash.0 Request processed in 593us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432625.953588:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 55 00000100:00100000:2.0:1787432625.957883:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432625.958095:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588412928 00000100:00100000:0.0:1787432625.958104:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588412928 00000100:00100000:0.0:1787432625.958200:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 56 00000100:00100000:0.0:1787432625.958216:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:12238:x1874258588412928:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787432625.958234:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432625.958253:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000086f663b/0xca72b3b33563f60f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f67 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.958460:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013439573/0xca72b3b33563f608 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f60 expref: 7 pid: 8806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.958470:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432625.958474:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432625.958479:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000086f663b/0xca72b3b33563f60f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f67 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.958517:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013439573/0xca72b3b33563f608 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f60 expref: 7 pid: 8806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.958544:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013439573/0xca72b3b33563f608 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f60 expref: 7 pid: 8806 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432625.958570:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f928000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1874258609453312:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787432625.958849:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432625.963488:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f928000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1874258609453312:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432625.963535:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000086f663b/0xca72b3b33563f60f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f67 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432625.963570:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304488600, rc 0) 00000100:00100000:3.0:1787432625.964132:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432625.964517:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:12238:x1874258588412928:12345-192.168.204.24@tcp:101:bash.0 Request processed in 6304us (6645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432625.964529:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 56 00000100:00100000:2.0:1787432625.966493:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588413056 00000100:00100000:2.0:1787432625.966513:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588413056 00010000:00010000:2.0:1787432625.966992:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013439573/0xca72b3b33563f608 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f60 expref: 7 pid: 8806 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432625.967241:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 82 00000100:00100000:2.0:1787432625.967254:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405942300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2402:x1874258588413056:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432625.967271:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432625.967308:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013439573/0xca72b3b33563f608 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f60 expref: 7 pid: 8806 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.967330:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013439573/0xca72b3b33563f608 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f60 expref: 7 pid: 8806 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.967353:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013439573/0xca72b3b33563f608 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f60 expref: 7 pid: 8806 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.967373:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432625.967378:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432625.967387:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000086f663b/0xca72b3b33563f60f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f67 expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.967399:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000086f663b/0xca72b3b33563f60f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f67 expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432625.967465:0:7465:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000086f663b/0xca72b3b33563f60f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f67 expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432625.967479:0:7465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a81f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7465:1874258609453440:192.168.204.24@tcp:105: 00000100:00100000:2.0:1787432625.967590:0:7465:0:(client.c:2715:ptlrpc_set_wait()) set ffff948402d0dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432625.971591:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432625.971864:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588413312 00000100:00100000:0.0:1787432625.971874:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588413312 00000100:00100000:0.0:1787432625.971930:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 36 00000100:00100000:0.0:1787432625.971941:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:12238:x1874258588413312:12345-192.168.204.24@tcp:35:bash.0 00000100:00100000:2.0:1787432625.972091:0:7465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a81f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7465:1874258609453440:192.168.204.24@tcp:105: 00010000:00010000:2.0:1787432625.972112:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432625.972160:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405942300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2402:x1874258588413056:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 4909us (8030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432625.972192:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 82 00000100:00100000:0.0:1787432625.972286:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:12238:x1874258588413312:12345-192.168.204.24@tcp:35:bash.0 Request processed in 346us (713us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787432625.972293:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 36 00000100:00100000:3.0:1787432626.061672:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432626.061859:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588413568 00000100:00100000:0.0:1787432626.061869:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588413568 00000100:00100000:0.0:1787432626.061942:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 158 00000100:00100000:0.0:1787432626.061955:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:12248:x1874258588413568:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787432626.061995:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432626.062017:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489200/0xca72b3b33563f616 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f6e expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432626.062154:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787432626.062314:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489200/0xca72b3b33563f616 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f6e expref: 23 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.062329:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9483032ad500) 00010000:00010000:0.0:1787432626.062333:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787432626.062338:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489200/0xca72b3b33563f616 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f6e expref: 23 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.062352:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304489200, rc 0) 00000100:00100000:0.0:1787432626.062415:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:12248:x1874258588413568:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 464us (755us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1787432626.062423:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 158 00000100:00080000:2.0:1787432626.062862:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432626.065753:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432626.065849:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588413824 00000100:00100000:0.0:1787432626.065861:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588413824 00000100:00100000:0.0:1787432626.065938:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 37 00000100:00100000:0.0:1787432626.065951:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:12248:x1874258588413824:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:0.0:1787432626.066248:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:12248:x1874258588413824:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 299us (517us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1787432626.066256:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 37 00000100:00100000:3.0:1787432626.137727:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432626.137965:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588413952 00000100:00100000:2.0:1787432626.137976:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588413952 00000100:00100000:2.0:1787432626.138057:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 159 00000100:00100000:2.0:1787432626.138069:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:12254:x1874258588413952:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432626.138093:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432626.138114:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f624 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f75 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432626.138219:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f62b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432626.138234:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f62b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432626.138245:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f62b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432626.138315:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787432626.138318:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787432626.138336:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f62b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432626.138363:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f624 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f75 expref: 25 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432626.138380:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f62b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f75 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432626.138390:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:2.0:1787432626.138393:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432626.138396:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85fa00, rc 0) 00000100:00100000:2.0:1787432626.138457:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+24:12254:x1874258588413952:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 391us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432626.138463:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 159 00000100:00100000:3.0:1787432626.144663:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432626.144794:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588414208 00000100:00100000:0.0:1787432626.144805:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588414208 00000100:00100000:0.0:1787432626.144875:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 160 00000100:00100000:0.0:1787432626.144905:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+24:12254:x1874258588414208:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787432626.144928:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432626.144953:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489200/0xca72b3b33563f632 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f7c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.145126:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f639 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.145141:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f639 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.145155:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f639 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432626.145203:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787432626.145329:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489200/0xca72b3b33563f632 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f7c expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.145353:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f639 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f7c expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.145363:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7500) 00010000:00010000:0.0:1787432626.145366:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432626.145371:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304489400, rc 0) 00000100:00100000:0.0:1787432626.145450:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+26:12254:x1874258588414208:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 548us (799us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1787432626.145458:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 160 00000100:00100000:3.0:1787432626.150089:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432626.150248:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588414464 00000100:00100000:0.0:1787432626.150258:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588414464 00000100:00100000:0.0:1787432626.150343:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 161 00000100:00100000:0.0:1787432626.150354:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+26:12254:x1874258588414464:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787432626.150379:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432626.150400:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563f647 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f83 expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.150501:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f64e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.150515:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f64e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.150527:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f64e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432626.150538:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787432626.150635:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563f647 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f83 expref: 29 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.150652:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f64e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f83 expref: 28 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.150661:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7500) 00010000:00010000:0.0:1787432626.150664:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787432626.150667:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304489a00, rc 0) 00000100:00100000:0.0:1787432626.150724:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+28:12254:x1874258588414464:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 373us (645us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1787432626.150730:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 161 00000100:00100000:2.0:1787432626.157327:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432626.157488:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588414592 00000100:00100000:3.0:1787432626.157498:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588414592 00000100:00100000:3.0:1787432626.157641:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 11 00000100:00100000:3.0:1787432626.157654:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+28:2400:x1874258588414592:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432626.157673:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432626.157700:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f639 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f7c expref: 28 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.157720:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7500) 00010000:00010000:3.0:1787432626.157725:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432626.157924:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:2400:x1874258588414592:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 272us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432626.157933:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 11 00000100:00100000:0.0:1787432626.161013:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432626.162002:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588414720 00000100:00100000:2.0:1787432626.162013:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588414720 00000100:00100000:2.0:1787432626.162299:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 57 00000100:00100000:2.0:1787432626.162311:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588414720:12345-192.168.204.24@tcp:1:lfs.0 00010000:00010000:2.0:1787432626.162360:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8b16f1a/0xca72b3b33563f65c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432626.162381:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000086f663b/0xca72b3b33563f60f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f67 expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432626.162404:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432626.162408:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432626.162412:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b16f1a/0xca72b3b33563f65c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432626.162447:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000086f663b/0xca72b3b33563f60f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f67 expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432626.162462:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000086f663b/0xca72b3b33563f60f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f67 expref: 6 pid: 8431 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432626.162477:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874258609453568:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432626.162568:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff948402d0dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432626.166652:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432626.166892:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588414848 00000100:00100000:0.0:1787432626.166905:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588414848 00002000:00100000:0.0:1787432626.166968:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff94843f91bb80 x1874258588414848/t0(0) o4->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:337/0 lens 504/0 e 0 to 0 dl 1787432637 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787432626.166981:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94843f91bb80 with x1874258588414848 ext(0->12) 00010000:00010000:0.0:1787432626.166993:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000086f663b/0xca72b3b33563f60f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f67 expref: 7 pid: 8431 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.167011:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000086f663b/0xca72b3b33563f60f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f67 expref: 7 pid: 8431 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787432626.167019:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94843f91bb80 00000100:00100000:0.0:1787432626.167068:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 2 00000100:00100000:0.0:1787432626.167079:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2402:x1874258588414848:12345-192.168.204.24@tcp:4:lfs.0 00000100:00100000:0.0:1787432626.168537:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2402:x1874258588414848:12345-192.168.204.24@tcp:4:lfs.0 Request processed in 1451us (1891us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787432626.168551:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 2 00002000:00100000:0.0:1787432626.168562:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff94843f91bb80 x1874258588414848/t4294967306(0) o4->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:337/0 lens 504/448 e 0 to 0 dl 1787432637 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787432626.168573:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94843f91bb80 with x1874258588414848 ext(0->12) 00010000:00010000:0.0:1787432626.168585:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000086f663b/0xca72b3b33563f60f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f67 expref: 9 pid: 8431 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.168602:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000086f663b/0xca72b3b33563f60f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f67 expref: 9 pid: 8431 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787432626.168627:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94843f91bb80 00000100:00080000:1.0:1787432626.169569:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432626.171597:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1874258609453568:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432626.171631:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f8b16f1a/0xca72b3b33563f65c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432626.172253:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432626.172402:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588414976 00000100:00100000:1.0:1787432626.172410:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588414976 00010000:00010000:1.0:1787432626.172450:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000086f663b/0xca72b3b33563f60f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f67 expref: 9 pid: 8431 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432626.172493:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 83 00000100:00100000:1.0:1787432626.172504:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2403:x1874258588414976:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432626.172521:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787432626.172544:0:6500:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787432626.172547:0:6500:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787432625 00002000:00010000:1.0:1787432626.172550:0:6500:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787432625 00002000:00010000:1.0:1787432626.172552:0:6500:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787432625 00002000:00010000:1.0:1787432626.172554:0:6500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787432626.172562:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000086f663b/0xca72b3b33563f60f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f67 expref: 9 pid: 8431 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432626.172575:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000086f663b/0xca72b3b33563f60f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f67 expref: 9 pid: 8431 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432626.172598:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000086f663b/0xca72b3b33563f60f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f67 expref: 9 pid: 8431 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432626.172614:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787432626.172626:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787432626.172632:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8b16f1a/0xca72b3b33563f65c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432626.172642:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b16f1a/0xca72b3b33563f65c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432626.172677:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432626.172731:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2403:x1874258588414976:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 228us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432626.172750:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 83 00010000:00010000:3.0:1787432626.172989:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f8b16f1a/0xca72b3b33563f65c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.173000:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8b16f1a/0xca72b3b33563f65c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.173160:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8b16f1a/0xca72b3b33563f65c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.173192:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b16f1a/0xca72b3b33563f65c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.173200:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8b16f1a/0xca72b3b33563f65c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.173208:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85f200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432626.173212:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8b16f1a/0xca72b3b33563f65c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.173220:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8b16f1a/0xca72b3b33563f65c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.173233:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8b16f1a/0xca72b3b33563f65c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.173240:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8b16f1a/0xca72b3b33563f65c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432626.173424:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2403:x1874258588414720:12345-192.168.204.24@tcp:1:lfs.0 Request processed in 11113us (12420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432626.173433:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 57 00000100:00100000:3.0:1787432626.176406:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432626.176484:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588415232 00000100:00100000:0.0:1787432626.176494:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588415232 00000100:00100000:0.0:1787432626.176658:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 38 00000100:00100000:0.0:1787432626.176670:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948411a1e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:12254:x1874258588415232:12345-192.168.204.24@tcp:35:lfs.0 00000004:00010000:0.0:1787432626.176733:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f64e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f83 expref: 27 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787432626.176940:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1787432626.176975:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787432626.177484:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1787432626.177535:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f663 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.177552:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f5fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f59 expref: 31 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.177562:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f663 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.177600:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f5fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f59 expref: 31 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.177615:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f5fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f59 expref: 31 pid: 6514 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432626.177630:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6516:1874258609453696:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787432626.177913:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f600 going to sleep for 11 seconds 00000100:00100000:1.0:1787432626.183761:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432626.183841:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588415360 00000100:00100000:2.0:1787432626.183853:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588415360 00010000:00010000:2.0:1787432626.183898:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f5fa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f59 expref: 32 pid: 6514 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432626.183976:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 84 00000100:00100000:2.0:1787432626.183987:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304462300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+32:2402:x1874258588415360:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432626.184036:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432626.184060:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f5fa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f59 expref: 32 pid: 6514 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432626.184075:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f5fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f59 expref: 32 pid: 6514 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432626.184098:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7500) 00010000:00010000:2.0:1787432626.184104:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f663 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432626.184114:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f663 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432626.184122:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f663 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432626.184142:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432626.184247:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304462300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+32:2402:x1874258588415360:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 262us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432626.184256:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 84 00010000:00010000:0.0:1787432626.185228:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f5fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f59 expref: 31 pid: 6514 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432626.185251:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6516:1874258609453696:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432626.185276:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f663 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.185296:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f663 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.185302:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f663 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787432626.185414:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1787432626.185549:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1787432626.185637:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874258609453824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787432626.185691:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432626.185726:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787432626.186156:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609453824 00000100:00100000:1.0:1787432626.186188:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609453824 00000100:00100000:1.0:1787432626.186249:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787432626.186258:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1874258609453824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787432626.186360:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1874258609453824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 103us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432626.186368:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787432626.187291:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874258609453824:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787432626.187437:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1787432626.187518:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304434a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874258609453952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787432626.187563:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432626.187594:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932fcc0 going to sleep for 11 seconds 00000100:00080000:0.0:1787432626.187611:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432626.187883:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609453952 00000100:00100000:1.0:1787432626.187889:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609453952 00000100:00100000:1.0:1787432626.187933:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787432626.187942:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6516:x1874258609453952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787432626.188093:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6516:x1874258609453952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 152us (529us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787432626.188101:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787432626.188140:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304434a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6516:1874258609453952:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787432626.188218:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1787432626.188252:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f663 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432626.188262:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f663 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432626.188270:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f663 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432626.188577:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432626.188584:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f663 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432626.188593:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f663 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432626.188610:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7500) 00010000:00010000:1.0:1787432626.188613:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787432626.188617:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f663 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432626.188623:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f663 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787432626.188724:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787432626.188854:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1787432626.188865:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437280699624ns, next at 438280697511ns, rc = 0 00000001:00080000:1.0:1787432626.188871:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1787432626.188900:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7500) 00010000:00010000:1.0:1787432626.188903:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787432626.188917:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f64e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f83 expref: 35 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432626.189019:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948411a1e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+34:12254:x1874258588415232:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 12351us (12623us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1787432626.189027:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 38 00000020:00080000:1.0:1787432626.189031:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787432626.191949:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432626.192637:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588415488 00000100:00100000:3.0:1787432626.192648:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588415488 00000100:00100000:3.0:1787432626.192760:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 162 00000100:00100000:3.0:1787432626.192775:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+34:12254:x1874258588415488:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432626.192800:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432626.192825:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f66a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f8a expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.192885:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f66a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f8a expref: 35 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.192899:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f66a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f8a expref: 35 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.192916:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:3.0:1787432626.192919:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787432626.192922:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303012000, rc 0) 00000100:00100000:3.0:1787432626.192985:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+35:12254:x1874258588415488:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 216us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432626.192992:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 162 00000100:00100000:1.0:1787432626.197125:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432626.197259:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588415744 00000100:00100000:0.0:1787432626.197268:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588415744 00000100:00100000:0.0:1787432626.197324:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 39 00000100:00100000:0.0:1787432626.197348:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+35:12254:x1874258588415744:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:0.0:1787432626.197577:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+36:12254:x1874258588415744:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 231us (461us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787432626.197585:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 39 00000100:00100000:1.0:1787432626.312843:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432626.312979:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588416000 00000100:00100000:3.0:1787432626.312991:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588416000 00000100:00100000:3.0:1787432626.313073:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 163 00000100:00100000:3.0:1787432626.313084:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+36:12264:x1874258588416000:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432626.313116:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432626.313136:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f671 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f91 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432626.313289:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787432626.313385:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f671 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f91 expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.313399:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9483032ad500) 00010000:00010000:3.0:1787432626.313402:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432626.313407:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f671 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f91 expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.313421:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303013c00, rc 0) 00000100:00100000:3.0:1787432626.313467:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+37:12264:x1874258588416000:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 386us (635us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1787432626.313475:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 163 00000100:00100000:2.0:1787432626.317628:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432626.317731:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588416128 00000100:00100000:0.0:1787432626.317741:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588416128 00000100:00100000:0.0:1787432626.317806:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 164 00000100:00100000:0.0:1787432626.317817:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+37:12264:x1874258588416128:12345-192.168.204.24@tcp:34:lfs.0 00010000:00010000:0.0:1787432626.317903:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f67f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.317924:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f67f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.317936:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f67f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.317949:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f686 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.317956:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.317962:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318229:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f68d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318238:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318259:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787432626.318320:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318369:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f67f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318387:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f67f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318398:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f67f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318404:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488800 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432626.318408:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f67f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318416:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f67f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318429:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:0.0:1787432626.318432:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432626.318437:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f67f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318443:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f67f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318455:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318467:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f686 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318473:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f686 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318477:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432626.318480:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f686 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318485:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f686 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318493:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9483026f7900) 00010000:00010000:0.0:1787432626.318495:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432626.318498:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f686 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318503:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f686 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318513:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318518:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f68d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318523:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f68d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318527:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432626.318536:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f68d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318543:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f68d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318551:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:0.0:1787432626.318553:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432626.318556:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f68d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.318562:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f68d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432626.318685:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+37:12264:x1874258588416128:12345-192.168.204.24@tcp:34:lfs.0 Request processed in 867us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432626.318694:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 164 00000100:00100000:1.0:1787432626.321977:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432626.322590:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588416384 00000100:00100000:0.0:1787432626.322602:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588416384 00000100:00100000:0.0:1787432626.322661:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 40 00000100:00100000:0.0:1787432626.322673:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+37:12264:x1874258588416384:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:0.0:1787432626.323308:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+38:12264:x1874258588416384:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 634us (1338us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787432626.323319:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 40 00010000:00010000:0.0:1787432626.379461:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432626.388959:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432626.389057:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588416640 00000100:00100000:3.0:1787432626.389069:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588416640 00000100:00100000:3.0:1787432626.389223:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 165 00000100:00100000:3.0:1787432626.389234:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+38:12267:x1874258588416640:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432626.389258:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432626.389280:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f694 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f98 expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389356:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f69b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389369:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f69b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389400:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f69b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389414:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948401683000/0xca72b3b33563f6a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389422:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948401683000/0xca72b3b33563f6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389429:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948401683000/0xca72b3b33563f6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389533:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948401682800/0xca72b3b33563f6a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389541:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948401682800/0xca72b3b33563f6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389561:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948401682800/0xca72b3b33563f6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432626.389570:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787432626.389637:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f69b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389644:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f69b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389650:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f69b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389656:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432626.389665:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f69b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389673:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f69b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389686:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:3.0:1787432626.389689:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432626.389693:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f69b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389700:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f69b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389714:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948401683000/0xca72b3b33563f6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389720:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948401683000/0xca72b3b33563f6a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389726:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948401683000/0xca72b3b33563f6a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389731:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948401683000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432626.389734:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948401683000/0xca72b3b33563f6a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389740:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948401683000/0xca72b3b33563f6a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.389747:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9483026f7900) 00010000:00010000:3.0:1787432626.389750:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432626.389759:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948401683000/0xca72b3b33563f6a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.393003:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948401683000/0xca72b3b33563f6a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.393097:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f694 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f98 expref: 41 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.393115:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948401682800/0xca72b3b33563f6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f98 expref: 40 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432626.393124:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:3.0:1787432626.393128:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432626.393131:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948401682800, rc 0) 00000100:00100000:3.0:1787432626.393235:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+40:12267:x1874258588416640:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 4001us (4284us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787432626.393245:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 165 00000100:00100000:1.0:1787432626.404160:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432626.408937:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588416768 00000100:00100000:0.0:1787432626.408957:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588416768 00000100:00100000:0.0:1787432626.409053:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 166 00000100:00100000:0.0:1787432626.409066:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+40:12267:x1874258588416768:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:0.0:1787432626.409213:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f6b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.409233:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.409246:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.409293:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f6b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.409301:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f6b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.409309:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f6b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.409315:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432626.409320:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f6b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.409329:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f6b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.409341:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:0.0:1787432626.409344:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787432626.409349:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f6b7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.409357:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f6b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432626.409460:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+40:12267:x1874258588416768:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 395us (5310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432626.409468:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 166 00000100:00100000:1.0:1787432626.412475:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432626.412572:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588417024 00000100:00100000:0.0:1787432626.412582:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588417024 00000100:00100000:0.0:1787432626.412632:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 41 00000100:00100000:0.0:1787432626.412643:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+40:12267:x1874258588417024:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:0.0:1787432626.413105:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+41:12267:x1874258588417024:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 462us (640us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787432626.413114:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 41 00000100:00100000:1.0:1787432626.822366:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432626.822649:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588417280 00000100:00100000:0.0:1787432626.822660:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588417280 00000100:00100000:0.0:1787432626.822738:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 167 00000100:00100000:0.0:1787432626.822749:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+41:12298:x1874258588417280:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787432626.822776:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432626.822797:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f6be lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4f9f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.822907:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f6c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.822923:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.822934:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432626.822967:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787432626.823090:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f6be lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f9f expref: 44 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.823109:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f6c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f9f expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432626.823118:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:0.0:1787432626.823121:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432626.823125:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304488400, rc 0) 00000100:00100000:0.0:1787432626.823262:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+43:12298:x1874258588417280:12345-192.168.204.24@tcp:101:cat.0 Request processed in 514us (920us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787432626.823271:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 167 00000100:00100000:2.0:1787432626.828955:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432626.830965:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588417408 00000100:00100000:1.0:1787432626.830984:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588417408 00000100:00100000:1.0:1787432626.831085:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:1.0:1787432626.831099:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94841223cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+43:2403:x1874258588417408:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432626.831117:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432626.831147:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b33563f6c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f9f expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432626.831187:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:1.0:1787432626.831193:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432626.831265:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94841223cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+42:2403:x1874258588417408:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 170us (2320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432626.831273:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:2.0:1787432626.843936:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432626.844063:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588417664 00000100:00100000:0.0:1787432626.844074:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588417664 00000100:00100000:0.0:1787432626.844135:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 42 00000100:00100000:0.0:1787432626.844146:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+42:12298:x1874258588417664:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:0.0:1787432626.844433:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+43:12298:x1874258588417664:12345-192.168.204.24@tcp:35:cat.0 Request processed in 288us (506us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1787432626.844440:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 42 00000100:00100000:0.0:1787432627.037400:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432627.037508:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588417920 00000100:00100000:3.0:1787432627.037518:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588417920 00000100:00100000:3.0:1787432627.037597:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 168 00000100:00100000:3.0:1787432627.037610:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+43:12304:x1874258588417920:12345-192.168.204.24@tcp:101:dd.0 00010000:00010000:3.0:1787432627.037640:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432627.037643:0:10165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787432627.037679:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f62b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f75 expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.037704:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:3.0:1787432627.037710:0:10165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432627.037747:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948401683000/0xca72b3b33563f6d3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4fa6 expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.037875:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f6da lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.037890:0:10165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948401682800/0xca72b3b33563f6a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f98 expref: 43 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.037898:0:10165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f6da lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.037938:0:10165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948401682800/0xca72b3b33563f6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f98 expref: 43 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.037952:0:10165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948401682800/0xca72b3b33563f6a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f98 expref: 43 pid: 10165 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432627.037966:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f918e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609454080:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432627.038558:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff948412a706c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432627.042067:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f918e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609454080:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432627.042101:0:10165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f6da lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432627.047451:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432627.047623:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588418048 00000100:00100000:3.0:1787432627.047632:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588418048 00010000:00010000:3.0:1787432627.047673:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948401682800/0xca72b3b33563f6a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f98 expref: 44 pid: 10165 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432627.047739:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 85 00000100:00100000:3.0:1787432627.047750:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+44:2402:x1874258588418048:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432627.047765:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432627.047772:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948401682800/0xca72b3b33563f6a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f98 expref: 44 pid: 10165 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.047784:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948401682800/0xca72b3b33563f6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f98 expref: 44 pid: 10165 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.047805:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948401682800/0xca72b3b33563f6a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f98 expref: 44 pid: 10165 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.047821:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:3.0:1787432627.047827:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f6da lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.047836:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f6da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.047844:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f6da lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.047881:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432627.047947:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+43:2402:x1874258588418048:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 199us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432627.047955:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 85 00010000:00010000:1.0:1787432627.048133:0:10165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f6da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.048143:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f6da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432627.048178:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787432627.048322:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948401683000/0xca72b3b33563f6d3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fa6 expref: 44 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.048338:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f6da lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fa6 expref: 43 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.048346:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:1.0:1787432627.048349:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787432627.048351:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303013c00, rc 0) 00000100:00100000:1.0:1787432627.048383:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+43:12304:x1874258588417920:12345-192.168.204.24@tcp:101:dd.0 Request processed in 10776us (10996us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787432627.048391:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 168 00000100:00100000:1.0:1787432627.052005:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432627.052222:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588418176 00000100:00100000:3.0:1787432627.052251:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588418176 00000100:00100000:3.0:1787432627.052314:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 169 00000100:00100000:3.0:1787432627.052324:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830383b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+43:12304:x1874258588418176:12345-192.168.204.24@tcp:101:dd.0 00010000:00010000:3.0:1787432627.052351:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432627.052372:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f6e8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4fad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.052422:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f6ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.052438:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f6ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.052451:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f6ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.052963:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013e00/0xca72b3b33563f6e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fad expref: 45 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.052983:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f6ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fad expref: 44 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.052992:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:3.0:1787432627.052995:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787432627.052999:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f0000, rc 0) 00000100:00100000:3.0:1787432627.053080:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830383b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+44:12304:x1874258588418176:12345-192.168.204.24@tcp:101:dd.0 Request processed in 757us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432627.053087:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 169 00000100:00100000:0.0:1787432627.055897:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432627.056012:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588418432 00000100:00100000:3.0:1787432627.056056:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588418432 00000100:00100000:3.0:1787432627.056122:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 170 00000100:00100000:3.0:1787432627.056133:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+44:12304:x1874258588418432:12345-192.168.204.24@tcp:36:dd.0 00010000:00010000:3.0:1787432627.056960:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563f6f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.056979:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563f6f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.056989:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563f6f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787432627.057054:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1787432627.057078:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d1f0877 reply state 00000000c87e981a transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563f6f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.057091:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563f6f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.057098:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:3.0:1787432627.057101:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787432627.057104:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787432627.057486:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+47:12304:x1874258588418432:12345-192.168.204.24@tcp:36:dd.0 Request processed in 1351us (1598us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1787432627.057495:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 170 00000020:00080000:3.0:1787432627.057501:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787432627.148629:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432627.148662:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609454464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432627.148783:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432627.148868:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609454464 00000100:00100000:3.0:1787432627.148876:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609454464 00000100:00100000:3.0:1787432627.149080:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787432627.149091:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874258609454464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432627.149117:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432627.149296:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787432627.149321:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609454208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432627.149371:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432627.149397:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609454336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432627.149418:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432627.149449:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609454208 00000100:00100000:0.0:1787432627.149454:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609454208 00000100:00100000:0.0:1787432627.149481:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787432627.149488:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609454208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432627.149513:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787432627.149560:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609454208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432627.149567:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787432627.149608:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609454208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432627.149647:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609454336 00000100:00100000:0.0:1787432627.149651:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609454336 00000100:00100000:0.0:1787432627.149678:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787432627.149684:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609454336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787432627.149694:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432627.149725:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609454336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432627.149731:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787432627.149760:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609454336:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787432627.149777:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432627.149807:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609454464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432627.150037:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874258609454464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432627.150044:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00010000:00010000:2.0:1787432627.403896:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432627.404112:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432627.406992:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588418560 00000100:00100000:3.0:1787432627.407027:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588418560 00000100:00100000:3.0:1787432627.407115:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 171 00000100:00100000:3.0:1787432627.407127:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+47:12318:x1874258588418560:12345-192.168.204.24@tcp:101:stat.0 00010000:00010000:3.0:1787432627.407258:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432627.407280:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563f6fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4fb4 expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.407567:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0800/0xca72b3b33563f704 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.407583:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0800/0xca72b3b33563f704 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.407595:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0800/0xca72b3b33563f704 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.407607:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b33563f70b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.407613:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b33563f70b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.407619:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b33563f70b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.407705:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563f712 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.407727:0:10165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f6da lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fa6 expref: 48 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.410040:0:10165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563f712 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.410107:0:10165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f6da lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fa6 expref: 48 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.410125:0:10165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f6da lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fa6 expref: 48 pid: 10165 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432627.410142:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f919500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609454592:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432627.410363:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff948412a706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432627.419213:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432627.419320:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588418816 00000100:00100000:0.0:1787432627.419331:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588418816 00000100:00100000:0.0:1787432627.419427:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 43 00000100:00100000:0.0:1787432627.419440:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+49:6171:x1874258588418816:12345-192.168.204.24@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787432627.419445:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f919500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609454592:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432627.419480:0:10165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563f712 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432627.419728:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+50:6171:x1874258588418816:12345-192.168.204.24@tcp:35:ldlm_bl.0 Request processed in 290us (527us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787432627.419745:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 43 00000100:00100000:1.0:1787432627.423922:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432627.424141:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588418944 00000100:00100000:3.0:1787432627.424153:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588418944 00010000:00010000:3.0:1787432627.424230:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f6da lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fa6 expref: 50 pid: 10165 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432627.424286:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 86 00000100:00100000:3.0:1787432627.424313:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+50:2402:x1874258588418944:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432627.424329:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432627.424336:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f6da lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fa6 expref: 50 pid: 10165 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.424351:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f6da lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fa6 expref: 50 pid: 10165 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.424376:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013c00/0xca72b3b33563f6da lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fa6 expref: 50 pid: 10165 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.424394:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:3.0:1787432627.424399:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563f712 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.424409:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563f712 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.424417:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563f712 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.425455:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432627.425562:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+49:2402:x1874258588418944:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 1248us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432627.425573:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 86 00010000:00010000:1.0:1787432627.426138:0:10165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563f712 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426151:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563f712 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432627.426300:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787432627.426452:0:10165:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432627.426556:0:10165:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563f712 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426572:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563f712 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426582:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0800/0xca72b3b33563f704 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426588:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0800/0xca72b3b33563f704 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426596:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0800/0xca72b3b33563f704 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426602:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0800 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432627.426606:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0800/0xca72b3b33563f704 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426613:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0800/0xca72b3b33563f704 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426628:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:1.0:1787432627.426631:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432627.426634:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0800/0xca72b3b33563f704 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426640:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0800/0xca72b3b33563f704 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426655:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b33563f70b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426672:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b33563f70b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426677:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b33563f70b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426681:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432627.426685:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b33563f70b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426691:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b33563f70b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426699:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9483026f7900) 00010000:00010000:1.0:1787432627.426702:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432627.426705:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b33563f70b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426711:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0400/0xca72b3b33563f70b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426924:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563f6fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fb4 expref: 49 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426942:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563f712 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fb4 expref: 48 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.426950:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:1.0:1787432627.426953:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432627.426963:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f1e00, rc 0) 00000100:00100000:1.0:1787432627.427324:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+48:12318:x1874258588418560:12345-192.168.204.24@tcp:101:stat.0 Request processed in 20197us (23218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432627.427334:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 171 00000100:00100000:1.0:1787432627.560928:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432627.561057:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588419200 00000100:00100000:0.0:1787432627.561068:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588419200 00000100:00100000:0.0:1787432627.561136:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 172 00000100:00100000:0.0:1787432627.561147:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+48:12324:x1874258588419200:12345-192.168.204.24@tcp:36:truncate.0 00010000:00010000:0.0:1787432627.561235:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432627.561265:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563f712 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fb4 expref: 48 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432627.561284:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:0.0:1787432627.561289:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432627.561476:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f719 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432627.561490:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432627.561499:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787432627.561544:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1787432627.561567:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db087ea6 reply state 00000000ca2e127f transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432627.561580:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f719 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432627.561603:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:0.0:1787432627.561606:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787432627.561608:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787432627.561714:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+50:12324:x1874258588419200:12345-192.168.204.24@tcp:36:truncate.0 Request processed in 569us (796us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787432627.561722:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 172 00000020:00080000:0.0:1787432627.561727:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787432627.660036:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432627.660062:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609454720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432627.660141:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432627.660507:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609454720 00000100:00100000:0.0:1787432627.660516:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609454720 00000100:00100000:0.0:1787432627.660593:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787432627.660604:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609454720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787432627.660631:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787432627.660681:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609454720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432627.660689:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787432627.661140:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609454720:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787432627.661185:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432627.663859:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609454848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432627.663944:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432627.664357:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609455104:0@lo:400:kworker.0 00000100:00100000:1.0:1787432627.664394:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432627.664412:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609455616:0@lo:400:kworker.0 00000100:00100000:1.0:1787432627.664432:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432627.664451:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787432627.664458:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609455232:0@lo:400:kworker.0 00000100:00100000:1.0:1787432627.664481:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432627.664498:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609455744:0@lo:400:kworker.0 00000100:00100000:1.0:1787432627.664520:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432627.664549:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609455360:0@lo:400:kworker.0 00000100:00100000:1.0:1787432627.664575:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432627.664592:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609455872:0@lo:400:kworker.0 00000100:00100000:1.0:1787432627.664612:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432627.664627:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787432627.664632:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830391a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609454976:0@lo:400:kworker.0 00000100:00100000:1.0:1787432627.664670:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432627.664690:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609455488:0@lo:400:kworker.0 00000100:00100000:1.0:1787432627.664712:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432627.664735:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609455360 00000100:00100000:1.0:1787432627.664930:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609455360 00000100:00100000:1.0:1787432627.664981:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787432627.664991:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609455360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432627.665127:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609455104 00000100:00100000:3.0:1787432627.665132:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609455104 00000100:00100000:3.0:1787432627.665153:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609455616 00000100:00100000:3.0:1787432627.665156:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609455616 00000100:00100000:3.0:1787432627.665211:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787432627.665219:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609455104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432627.665284:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609455104:12345-0@lo:400:kworker.0 Request processed in 66us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432627.665291:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787432627.665319:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609455232 00000100:00100000:3.0:1787432627.665323:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609455232 00000100:00100000:3.0:1787432627.665336:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609455744 00000100:00100000:3.0:1787432627.665339:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609455744 00000100:00100000:3.0:1787432627.665353:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609455872 00000100:00100000:3.0:1787432627.665355:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609455872 00000100:00100000:3.0:1787432627.665366:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609455488 00000100:00100000:3.0:1787432627.665368:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609455488 00000100:00100000:3.0:1787432627.665396:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787432627.665402:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609455616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432627.665436:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609455616:12345-0@lo:400:kworker.0 Request processed in 33us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432627.665442:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787432627.665454:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787432627.665460:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609455232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432627.665485:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609455232:12345-0@lo:400:kworker.0 Request processed in 26us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432627.665491:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787432627.665501:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787432627.665507:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609455744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432627.665534:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609455744:12345-0@lo:400:kworker.0 Request processed in 27us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432627.665549:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787432627.665561:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787432627.665567:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609455872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432627.665600:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609455872:12345-0@lo:400:kworker.0 Request processed in 34us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432627.665606:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787432627.665617:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787432627.665623:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609455488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432627.665647:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609455488:12345-0@lo:400:kworker.0 Request processed in 25us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432627.665652:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787432627.665671:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609454976 00000100:00100000:3.0:1787432627.665675:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609454976 00000100:00100000:3.0:1787432627.665697:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1787432627.665704:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609454976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432627.665733:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609454976:12345-0@lo:400:kworker.0 Request processed in 29us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432627.665755:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1787432627.665807:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609455232:0@lo:400:kworker.0 00000100:00100000:3.0:1787432627.665820:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609455744:0@lo:400:kworker.0 00000100:00100000:3.0:1787432627.665830:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609455104:0@lo:400:kworker.0 00010000:00080000:3.0:1787432627.665843:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484359e8000 x1874258609455616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432627.665866:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609455616:0@lo:400:kworker.0 00000100:00100000:3.0:1787432627.665904:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830391a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609454976:0@lo:400:kworker.0 00000100:00100000:3.0:1787432627.665915:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609455488:0@lo:400:kworker.0 00010000:00080000:3.0:1787432627.665925:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948304644a80 x1874258609455872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432627.665932:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609455872:0@lo:400:kworker.0 00000100:00080000:3.0:1787432627.665950:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432627.665955:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432627.666464:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609455360:12345-0@lo:400:kworker.0 Request processed in 1473us (1885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432627.666473:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787432627.666507:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609455360:0@lo:400:kworker.0 00000100:00100000:2.0:1787432627.666907:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609454848 00000100:00100000:2.0:1787432627.666914:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609454848 00000100:00100000:2.0:1787432627.666973:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787432627.666982:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609454848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787432627.667027:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787432627.667077:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609454848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (3133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432627.667084:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787432627.667119:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609454848:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787432627.667769:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432627.760376:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432627.760606:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588419328 00000100:00100000:3.0:1787432627.760617:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588419328 00000100:00100000:3.0:1787432627.760684:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 173 00000100:00100000:3.0:1787432627.760695:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+50:12338:x1874258588419328:12345-192.168.204.24@tcp:101:stat.0 00010000:00010000:3.0:1787432627.760728:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432627.760760:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f720 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4fbb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.760843:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563f727 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.760858:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563f727 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.760868:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563f727 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.760878:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563f72e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.760910:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563f72e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.760919:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563f72e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.760994:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563f735 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761004:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563f735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761031:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563f735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432627.761074:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787432627.761079:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787432627.761102:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563f735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761114:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563f735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761122:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563f727 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761129:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563f727 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761135:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563f727 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761152:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432627.761156:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563f727 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761196:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563f727 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761210:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:3.0:1787432627.761213:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432627.761217:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563f727 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761223:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563f727 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761237:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563f72e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761243:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563f72e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761248:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563f72e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761253:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432627.761255:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563f72e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761261:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563f72e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761278:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9483026f7900) 00010000:00010000:3.0:1787432627.761281:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432627.761284:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563f72e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761290:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563f72e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761329:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f720 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fbb expref: 52 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761342:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563f735 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fbb expref: 51 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.761350:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:3.0:1787432627.761352:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432627.761354:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f0200, rc 0) 00000100:00100000:3.0:1787432627.761422:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+51:12338:x1874258588419328:12345-192.168.204.24@tcp:101:stat.0 Request processed in 728us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432627.761429:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 173 00000100:00100000:1.0:1787432627.884466:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432627.884730:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588419584 00000100:00100000:3.0:1787432627.884741:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588419584 00000100:00100000:3.0:1787432627.884806:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 174 00000100:00100000:3.0:1787432627.884817:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+51:12348:x1874258588419584:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432627.884837:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432627.884855:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f73c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4fc2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432627.884982:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787432627.885104:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f73c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fc2 expref: 53 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.885118:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9483032ad500) 00010000:00010000:3.0:1787432627.885122:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432627.885126:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f73c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fc2 expref: 53 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.885140:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f1400, rc 0) 00000100:00100000:3.0:1787432627.885230:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+52:12348:x1874258588419584:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 415us (775us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1787432627.885237:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 174 00000100:00100000:0.0:1787432627.890879:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432627.891082:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588419840 00000100:00100000:1.0:1787432627.891094:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588419840 00000100:00100000:1.0:1787432627.891191:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 44 00000100:00100000:1.0:1787432627.891204:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948411a1f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+52:12348:x1874258588419840:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:1.0:1787432627.892830:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948411a1f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+53:12348:x1874258588419840:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 1620us (1953us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1787432627.892842:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 44 00000001:00080000:3.0:1787432627.896615:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00000004:00080000:3.0:1787432627.896656:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787432627.896679:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94840932f840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787432627.896684:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94843352f300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94840932f300 00000020:00080000:3.0:1787432627.896688:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94843352ff00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff948301db8400 00000100:00100000:3.0:1787432627.899617:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609456000:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787432627.899953:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f5ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900047:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f5ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900054:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f5ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900077:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303012800 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432627.900082:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f5ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900090:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f5ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900107:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9483026f7800) 00010000:00010000:1.0:1787432627.900110:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432627.900114:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f5ad lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900120:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012800/0xca72b3b33563f5ad lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900143:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f5b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900149:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f5b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900154:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f5b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900159:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303012400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432627.900162:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f5b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900420:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f5b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900439:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:1.0:1787432627.900442:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432627.900445:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f5b4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900451:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012400/0xca72b3b33563f5b4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900476:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f5f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900483:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f5f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900489:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f5f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900493:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432627.900496:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f5f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900502:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f5f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900509:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9483026f7900) 00010000:00010000:1.0:1787432627.900511:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432627.900514:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f5f3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900519:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303013600/0xca72b3b33563f5f3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900544:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563f6f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900550:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563f6f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900556:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563f6f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900560:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432627.900563:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563f6f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900568:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563f6f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900575:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:1.0:1787432627.900577:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432627.900580:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563f6f6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900585:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563f6f6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900593:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f719 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900599:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f719 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900604:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f719 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900615:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432627.900618:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f719 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900624:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f719 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900632:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:1.0:1787432627.900634:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432627.900636:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f719 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.900642:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f719 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787432627.900868:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1787432627.900928:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787432627.902053:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432627.903611:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609456000 00000100:00100000:2.0:1787432627.903625:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609456000 00000100:00100000:2.0:1787432627.903700:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787432627.903721:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843cb9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874258609456000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787432627.903755:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:2.0:1787432627.903799:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8a0eb1, atime: 0x6a8a0eb1, ctime: 0x6a8a0eb1, blocks: 0x8 00010000:00010000:2.0:1787432627.903807:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f74a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432627.903824:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=438s v=(0 0) 00010000:00010000:2.0:1787432627.903829:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432627.903836:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f74a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432627.903855:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f74a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432627.903865:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f74a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432627.903895:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f74a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432627.903935:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787432627.904159:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843cb9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1874258609456000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 440us (2112us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787432627.904202:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:1.0:1787432627.904661:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432627.904669:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f74a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.904678:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ea00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432627.904682:0:9519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f74a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.904691:0:9519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f74a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.904709:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f74a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.904732:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092ea1f82/0xca72b3b33563f74a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.904753:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432627.904755:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432627.904756:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787432627.905535:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9483039b6d80/2, rc 0, transno 4294967308 00000100:00100000:3.0:1787432627.905545:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609456000:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787432627.970127:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432627.970512:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588420096 00000100:00100000:2.0:1787432627.970523:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588420096 00000100:00100000:2.0:1787432627.970643:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 175 00000100:00100000:2.0:1787432627.970654:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:12354:x1874258588420096:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787432627.970682:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432627.970703:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f751 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4fc9 expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432627.970817:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f758 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432627.970834:0:9020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563f735 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fbb expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432627.970843:0:9020:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f758 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432627.970894:0:9020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563f735 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fbb expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432627.972279:0:9020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563f735 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fbb expref: 19 pid: 6513 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432627.972298:0:9020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9020:1874258609456128:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432627.972421:0:9020:0:(client.c:2715:ptlrpc_set_wait()) set ffff948402d0dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432627.977675:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432627.978690:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588420224 00000100:00100000:3.0:1787432627.978702:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588420224 00010000:00010000:3.0:1787432627.978839:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563f735 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fbb expref: 20 pid: 6513 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432627.978943:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 87 00000100:00100000:3.0:1787432627.978955:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:2403:x1874258588420224:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432627.978972:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432627.978981:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563f735 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fbb expref: 20 pid: 6513 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.978998:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563f735 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fbb expref: 20 pid: 6513 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.979051:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:3.0:1787432627.979057:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f758 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.979066:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f758 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.979074:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f758 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432627.979093:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432627.979200:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:2403:x1874258588420224:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 248us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432627.979208:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 87 00010000:00010000:0.0:1787432627.981803:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563f735 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fbb expref: 19 pid: 6513 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432627.981831:0:9020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9020:1874258609456128:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432627.981859:0:9020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f758 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432627.981962:0:9020:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f758 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432627.981969:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f758 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432627.981994:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787432627.982406:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f751 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fc9 expref: 20 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432627.982424:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f758 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fc9 expref: 19 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432627.982433:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:0.0:1787432627.982436:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787432627.982439:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e200, rc 0) 00000100:00100000:0.0:1787432627.982576:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:12354:x1874258588420096:12345-192.168.204.24@tcp:101:bash.0 Request processed in 11924us (12459us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787432627.982585:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 175 00000100:00100000:2.0:1787432627.988078:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432627.988987:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588420480 00000100:00100000:1.0:1787432627.988999:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588420480 00000100:00100000:1.0:1787432627.989126:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 176 00000100:00100000:1.0:1787432627.989138:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:12354:x1874258588420480:12345-192.168.204.24@tcp:36:bash.0 00010000:00010000:1.0:1787432627.989448:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f766 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.989466:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f766 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.989477:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f766 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787432627.989521:0:10165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1787432627.989543:0:10165:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f26ab667 reply state 00000000714bfd75 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f766 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.989555:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f766 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.989564:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:1.0:1787432627.989567:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787432627.989584:0:10165:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787432627.989684:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:12354:x1874258588420480:12345-192.168.204.24@tcp:36:bash.0 Request processed in 548us (1615us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1787432627.989692:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 176 00000020:00080000:1.0:1787432627.989696:0:10165:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787432627.999229:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432627.999336:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588420608 00000100:00100000:1.0:1787432627.999347:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588420608 00000100:00100000:1.0:1787432627.999525:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 177 00000100:00100000:1.0:1787432627.999537:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:12354:x1874258588420608:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787432627.999564:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432627.999588:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f76d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4fd0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.999695:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f774 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.999781:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f758 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fc9 expref: 23 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.999792:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f774 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.999828:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f758 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fc9 expref: 23 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432627.999843:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f758 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fc9 expref: 23 pid: 9020 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432627.999859:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874258609456256:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432628.000280:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff948406cb56c0 going to sleep for 10 seconds 00000100:00100000:1.0:1787432628.003218:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874258609456256:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432628.003269:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f774 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432628.006742:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432628.007665:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588420736 00000100:00100000:3.0:1787432628.007679:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588420736 00000100:00080000:1.0:1787432628.008795:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787432628.009501:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f758 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fc9 expref: 24 pid: 9020 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432628.009606:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 88 00000100:00100000:2.0:1787432628.009624:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+24:2402:x1874258588420736:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432628.009642:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432628.009651:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f758 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fc9 expref: 24 pid: 9020 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432628.009667:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f758 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fc9 expref: 24 pid: 9020 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432628.009693:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f758 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fc9 expref: 24 pid: 9020 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432628.009724:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:2.0:1787432628.009745:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f774 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432628.009754:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f774 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432628.009762:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f774 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432628.009795:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432628.009872:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:2402:x1874258588420736:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 255us (3142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432628.009881:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 88 00010000:00010000:1.0:1787432628.010418:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f774 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.010427:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f774 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432628.010483:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787432628.010488:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432628.010509:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f774 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.010543:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f76d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fd0 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.010561:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f774 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fd0 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.010569:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:1.0:1787432628.010572:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432628.010574:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851a00, rc 0) 00000100:00100000:1.0:1787432628.010623:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:12354:x1874258588420608:12345-192.168.204.24@tcp:101:bash.0 Request processed in 11089us (11405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432628.010631:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 177 00000100:00100000:2.0:1787432628.021590:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432628.021713:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588420992 00000100:00100000:0.0:1787432628.021723:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588420992 00000100:00100000:0.0:1787432628.021786:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 45 00000100:00100000:0.0:1787432628.021797:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:12354:x1874258588420992:12345-192.168.204.24@tcp:35:bash.0 00000100:00100000:0.0:1787432628.022044:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:12354:x1874258588420992:12345-192.168.204.24@tcp:35:bash.0 Request processed in 247us (463us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1787432628.022052:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 45 00000100:00100000:0.0:1787432628.152148:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432628.152573:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588421248 00000100:00100000:2.0:1787432628.152587:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588421248 00000100:00100000:2.0:1787432628.152654:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 178 00000100:00100000:2.0:1787432628.152664:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:12364:x1874258588421248:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432628.152694:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432628.152728:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f77b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4fd7 expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432628.152828:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787432628.153121:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f77b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fd7 expref: 25 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432628.153140:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9483032ad500) 00010000:00010000:2.0:1787432628.153143:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787432628.153148:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f77b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fd7 expref: 25 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432628.153203:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e200, rc 0) 00000100:00100000:2.0:1787432628.153409:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+24:12364:x1874258588421248:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 746us (1270us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1787432628.153417:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 178 00000100:00100000:0.0:1787432628.160339:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432628.161137:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588421376 00000100:00100000:1.0:1787432628.161151:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588421376 00000100:00100000:1.0:1787432628.161615:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 179 00000100:00100000:1.0:1787432628.161628:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+24:12364:x1874258588421376:12345-192.168.204.24@tcp:34:lfs.0 00010000:00010000:1.0:1787432628.161730:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f789 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.161749:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f789 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.161760:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f789 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.161775:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f790 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.161783:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.161790:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.161892:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f797 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.161902:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.161908:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787432628.161977:0:10165:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162019:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f789 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162034:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f789 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162041:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f789 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162046:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432628.162051:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f789 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162059:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f789 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162073:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:1.0:1787432628.162076:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432628.162081:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f789 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162086:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f789 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162101:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162106:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f790 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162111:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f790 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162122:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432628.162125:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f790 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162131:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f790 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162138:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9483032adb00) 00010000:00010000:1.0:1787432628.162141:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432628.162143:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f790 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162149:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f790 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162462:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162469:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f797 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162475:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f797 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162480:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432628.162483:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f797 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162488:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f797 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162506:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:1.0:1787432628.162508:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432628.162511:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f797 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.162516:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f797 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432628.162653:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+24:12364:x1874258588421376:12345-192.168.204.24@tcp:34:lfs.0 Request processed in 1025us (2320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432628.162663:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 179 00000100:00100000:2.0:1787432628.167515:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432628.167605:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588421632 00000100:00100000:1.0:1787432628.167617:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588421632 00000100:00100000:1.0:1787432628.167679:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 46 00000100:00100000:1.0:1787432628.167691:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+24:12364:x1874258588421632:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:1.0:1787432628.168126:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+25:12364:x1874258588421632:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 434us (620us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787432628.168136:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 46 00000100:00100000:2.0:1787432628.213650:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432628.213805:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588421888 00000100:00100000:1.0:1787432628.213818:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588421888 00000100:00100000:1.0:1787432628.213890:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 180 00000100:00100000:1.0:1787432628.213903:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+25:12367:x1874258588421888:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787432628.213925:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432628.213944:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f79e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4fde expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214028:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f7a5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214058:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f7a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214072:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f7a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214088:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f7ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214095:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f7ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214100:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f7ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214256:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f7b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214265:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f7b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214272:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f7b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432628.214281:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787432628.214516:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f7a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214524:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f7a5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214530:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f7a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214543:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432628.214547:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f7a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214555:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f7a5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214568:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:1.0:1787432628.214570:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432628.214575:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f7a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214581:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f7a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214594:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f7ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214601:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f7ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214606:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f7ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214611:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432628.214613:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f7ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214619:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f7ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214639:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9483032adb00) 00010000:00010000:1.0:1787432628.214642:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432628.214644:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f7ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214649:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f7ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214697:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f79e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fde expref: 28 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214712:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f7b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fde expref: 27 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.214719:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:1.0:1787432628.214721:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432628.214724:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851e00, rc 0) 00000100:00100000:1.0:1787432628.214897:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:12367:x1874258588421888:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 995us (1258us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787432628.214906:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 180 00000100:00100000:3.0:1787432628.223023:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432628.223458:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588422016 00000100:00100000:2.0:1787432628.223470:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588422016 00000100:00100000:2.0:1787432628.223591:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 13 00000100:00100000:2.0:1787432628.223605:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:2400:x1874258588422016:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432628.223626:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432628.223658:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f7b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fde expref: 27 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432628.223681:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:2.0:1787432628.223687:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432628.223756:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+26:2400:x1874258588422016:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 155us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432628.223765:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 13 00000100:00100000:0.0:1787432628.230992:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432628.231120:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588422144 00000100:00100000:3.0:1787432628.231135:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588422144 00000100:00100000:3.0:1787432628.235032:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 181 00000100:00100000:3.0:1787432628.235057:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+26:12367:x1874258588422144:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:3.0:1787432628.235131:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.235148:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.235159:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.235208:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.235214:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.235221:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.235226:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432628.235231:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.235238:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.235249:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:3.0:1787432628.235252:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432628.235269:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.235275:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432628.235570:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+26:12367:x1874258588422144:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 523us (4592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432628.235580:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 181 00000100:00100000:0.0:1787432628.239159:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432628.239232:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588422400 00000100:00100000:2.0:1787432628.239245:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588422400 00000100:00100000:2.0:1787432628.239316:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 47 00000100:00100000:2.0:1787432628.239328:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+26:12367:x1874258588422400:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:2.0:1787432628.239600:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:12367:x1874258588422400:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 273us (451us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787432628.239621:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 47 00000100:00100000:0.0:1787432628.412219:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432628.412321:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588422656 00000100:00100000:1.0:1787432628.412334:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588422656 00000100:00100000:1.0:1787432628.412450:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 182 00000100:00100000:1.0:1787432628.412461:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:12385:x1874258588422656:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:1.0:1787432628.412490:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432628.412515:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f7c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4fe5 expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.412677:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f7cf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.412702:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f7cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.412714:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f7cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432628.412725:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787432628.412858:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f7c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fe5 expref: 30 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.412876:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f7cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fe5 expref: 29 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.412884:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:1.0:1787432628.412888:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787432628.412891:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851c00, rc 0) 00000100:00100000:1.0:1787432628.412958:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+29:12385:x1874258588422656:12345-192.168.204.24@tcp:101:cat.0 Request processed in 499us (751us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1787432628.412965:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 182 00010000:00010000:0.0:1787432628.427638:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432628.461815:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432628.461914:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588422784 00000100:00100000:3.0:1787432628.461924:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588422784 00000100:00100000:3.0:1787432628.462007:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 183 00000100:00100000:3.0:1787432628.462019:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+29:12386:x1874258588422784:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432628.462058:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432628.462080:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4fec expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.462162:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563f7e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.462210:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563f7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.462220:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563f7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432628.462275:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787432628.462279:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787432628.462297:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563f7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.462604:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fec expref: 31 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.462624:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563f7e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fec expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.462632:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:3.0:1787432628.462634:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432628.462638:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f0600, rc 0) 00000100:00100000:3.0:1787432628.462716:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:12386:x1874258588422784:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 699us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432628.462723:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 183 00000100:00100000:0.0:1787432628.473389:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432628.473537:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588423168 00000100:00100000:3.0:1787432628.473547:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588423168 00000100:00100000:3.0:1787432628.473609:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 48 00000100:00100000:3.0:1787432628.473621:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:12386:x1874258588423168:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:3.0:1787432628.473928:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+31:12386:x1874258588423168:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 307us (548us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787432628.473935:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 48 00000100:00100000:1.0:1787432628.477537:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432628.477633:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588423296 00000100:00100000:3.0:1787432628.477644:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588423296 00000100:00100000:3.0:1787432628.477814:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00100000:3.0:1787432628.477825:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304644000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+31:12386:x1874258588423296:12345-192.168.204.24@tcp:103:lfs.0 00010000:00010000:3.0:1787432628.477843:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787432628.477870:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f774 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fd0 expref: 31 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.477910:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f7cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fe5 expref: 30 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.477924:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303012000/0xca72b3b33563f66a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f8a expref: 29 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.477935:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:3.0:1787432628.477951:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432628.478017:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304644000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+28:12386:x1874258588423296:12345-192.168.204.24@tcp:103:lfs.0 Request processed in 193us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432628.478031:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00100000:0.0:1787432628.481980:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432628.482599:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588423424 00000100:00100000:3.0:1787432628.482611:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588423424 00000100:00100000:3.0:1787432628.482685:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 184 00000100:00100000:3.0:1787432628.482707:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+28:12386:x1874258588423424:12345-192.168.204.24@tcp:58:lfs.0 00010000:00010000:3.0:1787432628.482861:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7eb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.482882:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432628.482894:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787432628.483019:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787432628.483143:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+28:12386:x1874258588423424:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 448us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432628.483188:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 184 00000100:00100000:0.0:1787432628.537717:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432628.537933:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588423552 00000100:00100000:1.0:1787432628.537944:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588423552 00000100:00100000:1.0:1787432628.538018:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 185 00000100:00100000:1.0:1787432628.538039:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+28:12388:x1874258588423552:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787432628.538080:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432628.538103:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f7f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4ff3 expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.540552:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f7f9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.540570:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f7f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.540582:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f7f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.540600:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f800 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.540607:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.540613:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.540708:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f807 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.540719:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f807 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.540726:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f807 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432628.540775:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787432628.540808:0:10165:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432628.540834:0:10165:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f807 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.540849:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f807 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.540857:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f7f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.540863:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f7f9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.540870:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f7f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.540877:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432628.540881:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f7f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.542223:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f7f9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.542307:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:1.0:1787432628.542311:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432628.542316:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f7f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.542324:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f7f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.542414:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.542664:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f800 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.542671:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.542676:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432628.542680:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.542687:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f800 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.542758:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9483032adb00) 00010000:00010000:1.0:1787432628.542760:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432628.542764:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f800 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.542770:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850400/0xca72b3b33563f800 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.543513:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f7f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ff3 expref: 30 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.543535:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f807 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ff3 expref: 29 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432628.543544:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:1.0:1787432628.543547:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432628.543559:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851000, rc 0) 00000100:00100000:2.0:1787432628.543761:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+29:12388:x1874258588423552:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 5721us (6053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432628.543771:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 185 00000100:00100000:3.0:1787432629.195490:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f91ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609456384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432629.195562:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432629.200061:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609456384 00000100:00100000:0.0:1787432629.200076:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609456384 00000100:00100000:0.0:1787432629.200154:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787432629.200190:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609456384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432629.200519:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432629.200616:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609456384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 428us (5053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432629.200625:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787432629.200730:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f91ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609456384:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787432629.457705:0:13810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787432629.457714:0:13810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787432629.457749:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787432629.457757:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787432629.457897:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13810:1874258609456512:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787432629.458017:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d9600 going to sleep for 11 seconds 00000040:00080000:3.0:1787432629.464353:0:14617:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787432629.464364:0:14617:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787432629.464387:0:14617:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787432629.464394:0:14617:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787432629.466479:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432629.466764:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432629.466798:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588423680 00000100:00100000:0.0:1787432629.466808:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588423680 00000100:00100000:0.0:1787432629.466865:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 186 00000100:00100000:0.0:1787432629.466876:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:12399:x1874258588423680:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787432629.466914:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787432629.467052:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:12399:x1874258588423680:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 177us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432629.467059:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 186 00000100:00100000:1.0:1787432629.468062:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13810:1874258609456512:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787432629.472910:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432629.476975:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588423808 00000100:00100000:2.0:1787432629.477002:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588423808 00000100:00100000:2.0:1787432629.477070:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 187 00000100:00100000:2.0:1787432629.477081:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+29:12399:x1874258588423808:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787432629.477157:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f80e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477192:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f80e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477205:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f80e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477233:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f815 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477242:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f815 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477249:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f815 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477279:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f81c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477288:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f81c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477310:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f81c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432629.477356:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787432629.477361:0:9020:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787432629.477374:0:9020:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f81c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477385:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f80e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477390:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f80e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477396:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f80e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477402:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432629.477406:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f80e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477412:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f80e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477424:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94841318b400) 00010000:00010000:2.0:1787432629.477427:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432629.477431:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f80e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477437:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f80e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477460:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f815 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477466:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f815 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477472:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f815 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477477:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fa00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432629.477480:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f815 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477485:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f815 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477492:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff948411a6ba00) 00010000:00010000:2.0:1787432629.477495:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432629.477497:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f815 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477503:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f815 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477517:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f81c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477523:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f81c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477528:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f81c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477538:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ea00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432629.477541:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f81c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477547:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f81c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477556:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:2.0:1787432629.477558:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432629.477561:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f81c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.477567:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f81c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432629.477642:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+29:12399:x1874258588423808:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 563us (4742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432629.477650:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 187 00000100:00100000:2.0:1787432629.480271:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432629.480382:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588424064 00000100:00100000:3.0:1787432629.480395:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588424064 00000100:00100000:3.0:1787432629.480462:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 188 00000100:00100000:3.0:1787432629.480474:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+29:12399:x1874258588424064:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432629.480498:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432629.480521:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563f823 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d4ffa expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.480649:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f82a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.480666:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f82a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.480691:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f82a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432629.480704:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787432629.480787:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f82a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.480808:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f82a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.480814:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f82a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.480819:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432629.480823:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f82a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.480830:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f82a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.480842:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:3.0:1787432629.480844:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432629.480849:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f82a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.480855:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f82a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.480894:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563f823 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ffa expref: 31 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.480904:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94841318b400) 00010000:00010000:3.0:1787432629.480906:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432629.480909:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563f823 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ffa expref: 31 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.480918:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f0e00, rc 0) 00000100:00100000:3.0:1787432629.480989:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:12399:x1874258588424064:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 505us (717us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1787432629.480996:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 188 00000100:00100000:2.0:1787432629.485661:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432629.486127:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588424192 00000100:00100000:3.0:1787432629.486138:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588424192 00000100:00100000:3.0:1787432629.486221:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 189 00000100:00100000:3.0:1787432629.486232:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:12399:x1874258588424192:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787432629.486266:0:6514:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787432629.486382:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:12399:x1874258588424192:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 152us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432629.486389:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 189 00000100:00100000:2.0:1787432629.507871:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432629.507918:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588424448 00000100:00100000:2.0:1787432629.507927:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588424448 00000100:00100000:2.0:1787432629.507993:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 190 00000100:00100000:2.0:1787432629.508005:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:12399:x1874258588424448:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787432629.508036:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432629.508040:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787432629.508068:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563f7e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fec expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.508095:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:2.0:1787432629.508101:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432629.508116:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f838 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5001 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787432629.508501:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787432629.508647:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f83f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.508660:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f83f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.508669:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f83f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.508739:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f838 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5001 expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.508754:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f83f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5001 expref: 31 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.508761:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948411a6ba00) 00010000:00010000:2.0:1787432629.508764:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432629.508766:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85fa00, rc 0) 00000100:00100000:2.0:1787432629.508827:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+31:12399:x1874258588424448:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 824us (970us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1787432629.508834:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 190 00000100:00100000:1.0:1787432629.513361:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432629.513440:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588424704 00000100:00100000:0.0:1787432629.513450:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588424704 00000100:00100000:0.0:1787432629.513513:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 191 00000100:00100000:0.0:1787432629.513525:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+31:12399:x1874258588424704:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787432629.513589:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432629.513618:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f83f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5001 expref: 31 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513633:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948411a6ba00) 00010000:00010000:0.0:1787432629.513643:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432629.513664:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f84d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513687:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f84d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513697:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f84d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513712:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f854 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x679c554b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513718:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f854 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x679c554b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513725:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f854 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x679c554b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513767:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f84d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513788:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f84d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513794:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f84d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513799:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432629.513804:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f84d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513812:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f84d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513821:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:0.0:1787432629.513824:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432629.513827:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f84d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513833:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563f84d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513844:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f854 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x679c554b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513850:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f854 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x679c554b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513856:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f854 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x679c554b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513861:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489a00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432629.513870:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f854 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x679c554b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513876:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f854 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x679c554b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513885:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x679c554b (ffff948411a7ac00) 00010000:00010000:0.0:1787432629.513887:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432629.513890:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f854 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x679c554b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.513895:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489a00/0xca72b3b33563f854 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x679c554b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432629.513974:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:12399:x1874258588424704:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 450us (622us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787432629.513991:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 191 00000100:00100000:2.0:1787432629.522885:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432629.522963:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588424832 00000100:00100000:0.0:1787432629.522973:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588424832 00000100:00100000:0.0:1787432629.523055:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 192 00000100:00100000:0.0:1787432629.523066:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:12399:x1874258588424832:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432629.523088:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432629.523115:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f85b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5008 expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.523153:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f862 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.523196:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f862 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.523430:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f862 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.523564:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f85b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5008 expref: 32 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.523583:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f862 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5008 expref: 31 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.523592:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948411a7a400) 00010000:00010000:0.0:1787432629.523595:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787432629.523599:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304488200, rc 0) 00000100:00100000:0.0:1787432629.523790:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+31:12399:x1874258588424832:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 724us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432629.523798:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 192 00000100:00100000:0.0:1787432629.554477:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432629.554556:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588425088 00000100:00100000:2.0:1787432629.554565:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588425088 00000100:00100000:2.0:1787432629.554620:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 193 00000100:00100000:2.0:1787432629.554630:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+31:12399:x1874258588425088:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787432629.554718:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f869 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.554735:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f869 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.554747:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f869 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787432629.554897:0:10165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1787432629.554906:0:10165:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440646741215ns, next at 441646739043ns, rc = 0 00000004:00010000:2.0:1787432629.554948:0:10165:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c9acc50 reply state 000000001667b112 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f869 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.554961:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f869 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.554969:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948411a7a400) 00010000:00010000:2.0:1787432629.554972:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787432629.554983:0:10165:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787432629.555077:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+33:12399:x1874258588425088:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 448us (609us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787432629.555085:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 193 00000100:00100000:2.0:1787432629.563802:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432629.565867:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588425216 00000100:00100000:1.0:1787432629.565881:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588425216 00000100:00100000:1.0:1787432629.565990:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 194 00000100:00100000:1.0:1787432629.566002:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483038c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+33:12399:x1874258588425216:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432629.566043:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432629.566067:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f870 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d500f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.566129:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f870 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d500f expref: 34 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.566142:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f870 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d500f expref: 34 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.566160:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948411a7a400) 00010000:00010000:1.0:1787432629.566200:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787432629.566211:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850e00, rc 0) 00000100:00100000:1.0:1787432629.566282:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483038c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+34:12399:x1874258588425216:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 282us (2487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432629.566290:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 194 00000100:00100000:3.0:1787432629.571867:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432629.571911:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588425344 00000100:00100000:3.0:1787432629.571921:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588425344 00000100:00100000:3.0:1787432629.572015:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 59 00000100:00100000:3.0:1787432629.572030:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2402:x1874258588425344:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787432629.572300:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2402:x1874258588425344:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 273us (455us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787432629.572308:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 59 00000100:00080000:0.0:1787432629.574198:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432629.579377:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432629.579450:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588425600 00000100:00100000:1.0:1787432629.579460:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588425600 00000100:00100000:1.0:1787432629.579518:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 49 00000100:00100000:1.0:1787432629.579529:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+34:12399:x1874258588425600:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787432629.579785:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+35:12399:x1874258588425600:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 257us (418us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1787432629.579793:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 49 00000100:00100000:3.0:1787432629.581787:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432629.582062:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588425856 00000100:00100000:0.0:1787432629.582071:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588425856 00000100:00100000:0.0:1787432629.582135:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 195 00000100:00100000:0.0:1787432629.582146:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+35:12399:x1874258588425856:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787432629.582305:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+35:12399:x1874258588425856:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 160us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432629.582313:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 195 00000100:00100000:3.0:1787432629.587496:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432629.587582:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588425984 00000100:00100000:1.0:1787432629.587592:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588425984 00000100:00100000:1.0:1787432629.587653:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 196 00000100:00100000:1.0:1787432629.587664:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+35:12399:x1874258588425984:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432629.587695:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432629.587717:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f877 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5016 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.587785:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f87e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.587800:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f87e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.587812:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f87e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432629.587879:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432629.587897:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f87e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.587923:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f877 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5016 expref: 37 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.587941:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f87e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5016 expref: 36 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.587949:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948411a7a400) 00010000:00010000:1.0:1787432629.587952:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787432629.587955:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851c00, rc 0) 00000100:00100000:1.0:1787432629.588021:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+36:12399:x1874258588425984:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 360us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432629.588029:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 196 00000100:00100000:0.0:1787432629.595728:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432629.595881:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588426112 00000100:00100000:2.0:1787432629.595899:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588426112 00000100:00100000:2.0:1787432629.595967:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 60 00000100:00100000:2.0:1787432629.595986:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2402:x1874258588426112:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787432629.596007:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432629.596036:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f885 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d501d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787432629.596063:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a0eb5, blocks: 0x0 00010000:00010000:2.0:1787432629.596085:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1787432629.596090:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432629.596099:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f885 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d501d expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.596118:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f885 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d501d expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.596131:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85fc00, rc 0) 00000100:00100000:2.0:1787432629.596243:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2402:x1874258588426112:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 266us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432629.596250:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 60 00000100:00100000:3.0:1787432629.605964:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432629.606064:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588426368 00000100:00100000:2.0:1787432629.606074:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588426368 00000100:00100000:2.0:1787432629.606136:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 197 00000100:00100000:2.0:1787432629.606146:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+36:12399:x1874258588426368:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787432629.606287:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+36:12399:x1874258588426368:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 141us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432629.606310:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 197 00000100:00100000:0.0:1787432629.615821:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432629.615947:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588426496 00000100:00100000:3.0:1787432629.615959:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588426496 00000100:00100000:3.0:1787432629.616033:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 61 00000100:00100000:3.0:1787432629.616045:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:12399:x1874258588426496:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432629.616076:0:8806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432629.616096:0:8806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33563f88c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5024 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.616129:0:8806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f885 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d501d expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.616138:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432629.616142:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432629.616147:0:8806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33563f88c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5024 expref: 9 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.616317:0:8806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f885 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d501d expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.616331:0:8806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f885 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d501d expref: 9 pid: 8432 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432629.616346:0:8806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303919500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8806:1874258609456640:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432629.616437:0:8806:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303015d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787432629.619721:0:8806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303919500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8806:1874258609456640:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432629.619758:0:8806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33563f88c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5024 expref: 9 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.619778:0:8806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f0e00, rc 0) 00000100:00100000:3.0:1787432629.619844:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:12399:x1874258588426496:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 3800us (4032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432629.619853:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 61 00000100:00100000:1.0:1787432629.620052:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432629.621136:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588426624 00000100:00100000:3.0:1787432629.621147:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588426624 00010000:00010000:3.0:1787432629.621208:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f885 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d501d expref: 9 pid: 8432 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432629.621475:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 89 00000100:00100000:3.0:1787432629.621487:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94841223ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2402:x1874258588426624:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432629.621503:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432629.621527:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f885 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d501d expref: 9 pid: 8432 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.621542:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f885 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d501d expref: 9 pid: 8432 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.621565:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f885 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d501d expref: 9 pid: 8432 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.621580:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432629.621584:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432629.621594:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33563f88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5024 expref: 8 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.621604:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33563f88c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5024 expref: 8 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.621654:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33563f88c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5024 expref: 8 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432629.622018:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303919500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6498:1874258609456768:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787432629.622245:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303015d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432629.634933:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432629.636424:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588426752 00000100:00100000:3.0:1787432629.636437:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588426752 00002000:00100000:3.0:1787432629.636492:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff948304647800 x1874258588426752/t0(0) o4->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:340/0 lens 504/0 e 0 to 0 dl 1787432640 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787432629.636503:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948304647800 with x1874258588426752 ext(0->8) 00002000:00010000:3.0:1787432629.636509:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948304647800 00000100:00100000:3.0:1787432629.636547:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 4 00000100:00100000:3.0:1787432629.636556:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2403:x1874258588426752:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787432629.637013:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303919500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6498:1874258609456768:192.168.204.24@tcp:105: 00010000:00010000:3.0:1787432629.637034:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432629.637092:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94841223ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+11:2402:x1874258588426624:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 15608us (17040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432629.637102:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 89 00000100:00100000:3.0:1787432629.639955:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+10:2403:x1874258588426752:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 3387us (5020us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787432629.639971:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 4 00002000:00100000:3.0:1787432629.639997:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff948304647800 x1874258588426752/t4294967315(0) o4->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:340/0 lens 504/448 e 0 to 0 dl 1787432640 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787432629.640020:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948304647800 with x1874258588426752 ext(0->8) 00002000:00010000:3.0:1787432629.640027:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948304647800 00000100:00100000:3.0:1787432629.657025:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432629.657062:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588426880 00000100:00100000:3.0:1787432629.657071:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588426880 00000100:00100000:3.0:1787432629.657125:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 198 00000100:00100000:3.0:1787432629.657135:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+36:12399:x1874258588426880:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787432629.661014:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1787432629.661031:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1787432629.661061:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:3.0:1787432629.661090:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f766 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.661103:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f766 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.661112:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f766 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.661118:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432629.661123:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f766 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.661130:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f766 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.661147:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:3.0:1787432629.661149:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432629.661196:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f766 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.661204:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f766 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.661287:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f869 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.661294:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f869 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.661300:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f869 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.661306:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85f200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432629.661309:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f869 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.661315:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f869 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.661324:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948411a7a400) 00010000:00010000:3.0:1787432629.661326:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787432629.661330:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f869 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.661335:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f869 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432629.661471:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:12399:x1874258588426880:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 4333us (4449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432629.661482:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 198 00000020:00080000:2.0:1787432629.661746:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1787432629.661757:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787432629.661764:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432629.661780:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609456896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787432629.661830:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432629.661866:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609456896 00000100:00100000:2.0:1787432629.661873:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609456896 00000100:00100000:2.0:1787432629.661918:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787432629.661925:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609456896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787432629.662051:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787432629.662055:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787432629 00002000:00010000:2.0:1787432629.662057:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787432629.662059:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787432629 -> 1787432629 00002000:00010000:2.0:1787432629.662061:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787432629.662096:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609456896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (265us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787432629.662103:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:2.0:1787432629.662146:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff948435b64a80/2, rc 0, transno 4294967316 00000100:00100000:2.0:1787432629.662152:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609456896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787432629.664510:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432629.664541:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588427008 00000100:00100000:3.0:1787432629.664550:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588427008 00000100:00100000:3.0:1787432629.664588:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 63 00000100:00100000:3.0:1787432629.664597:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830391a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+10:2403:x1874258588427008:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00000100:00080000:0.0:1787432629.667021:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1787432629.676454:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1787432629.676473:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1787432629.676600:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830391a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2403:x1874258588427008:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 11998us (12092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432629.676612:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 63 00000100:00100000:1.0:1787432629.689318:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432629.690250:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588427264 00000100:00100000:3.0:1787432629.690262:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588427264 00000100:00100000:3.0:1787432629.690319:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 199 00000100:00100000:3.0:1787432629.690329:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:12399:x1874258588427264:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787432629.690381:0:9020:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432629.690410:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f87e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5016 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.690429:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948411a7a400) 00010000:00010000:3.0:1787432629.690435:0:9020:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432629.690463:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f893 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.690478:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f893 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.690488:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f893 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432629.690610:0:9020:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df1f928a reply state 000000008cf35752 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f893 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.690623:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f893 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.690643:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948411a7a400) 00010000:00010000:3.0:1787432629.690645:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787432629.690648:0:9020:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787432629.691371:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:12399:x1874258588427264:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 1040us (2060us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1787432629.691380:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 199 00000100:00100000:3.0:1787432629.695424:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432629.695494:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588427392 00000100:00100000:2.0:1787432629.695510:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588427392 00000100:00100000:2.0:1787432629.695569:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 64 00000100:00100000:2.0:1787432629.695583:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2403:x1874258588427392:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787432629.695845:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787432629.695849:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787432629 -> 1787432627 00002000:00010000:2.0:1787432629.695852:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787432625 00002000:00010000:2.0:1787432629.695854:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787432629 -> 1787432627 00002000:00010000:2.0:1787432629.695857:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787432629.695920:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2403:x1874258588427392:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 339us (502us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787432629.695928:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 64 00000100:00100000:1.0:1787432629.699409:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432629.699536:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588427648 00000100:00100000:3.0:1787432629.699546:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588427648 00000100:00100000:3.0:1787432629.699605:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 200 00000100:00100000:3.0:1787432629.699616:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:12399:x1874258588427648:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787432629.699953:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563f89a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.699971:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f862 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5008 expref: 20 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.699990:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563f89a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.700112:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f862 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5008 expref: 20 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.700126:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f862 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5008 expref: 20 pid: 9020 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432629.700141:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874258609457024:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432629.700450:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303015900 going to sleep for 11 seconds 00000100:00100000:0.0:1787432629.706069:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874258609457024:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432629.706101:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563f89a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432629.706319:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432629.706389:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588427776 00000100:00100000:2.0:1787432629.706396:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588427776 00010000:00010000:2.0:1787432629.706435:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f862 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5008 expref: 21 pid: 9020 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432629.706475:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 90 00000100:00100000:2.0:1787432629.706485:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304647b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:2403:x1874258588427776:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432629.706501:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432629.706507:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f862 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5008 expref: 21 pid: 9020 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.706519:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f862 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5008 expref: 21 pid: 9020 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.706540:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488200/0xca72b3b33563f862 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5008 expref: 21 pid: 9020 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.706572:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948411a7a400) 00010000:00010000:2.0:1787432629.706576:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563f89a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.706585:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563f89a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.706592:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563f89a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.706620:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432629.706682:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304647b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:2403:x1874258588427776:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 198us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432629.706690:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 90 00010000:00010000:0.0:1787432629.706792:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563f89a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.706800:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563f89a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.706836:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563f89a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.706843:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563f89a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.706849:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563f89a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.706855:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1800 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432629.706860:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563f89a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.706867:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563f89a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.706877:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948411a7a400) 00010000:00010000:0.0:1787432629.706879:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787432629.706883:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563f89a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.706899:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563f89a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432629.706937:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:12399:x1874258588427648:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 7323us (7538us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787432629.706945:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 200 00000100:00100000:2.0:1787432629.709888:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432629.709961:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588427904 00000100:00100000:0.0:1787432629.709970:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588427904 00000100:00100000:0.0:1787432629.710061:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 65 00000100:00100000:0.0:1787432629.710073:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2403:x1874258588427904:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787432629.710117:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001ff627d3/0xca72b3b33563f8a1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.710138:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33563f88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5024 expref: 8 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.710147:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432629.710151:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432629.710156:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ff627d3/0xca72b3b33563f8a1 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.710233:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33563f88c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5024 expref: 8 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.710247:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33563f88c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5024 expref: 8 pid: 8806 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432629.710275:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874258609457152:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787432629.710351:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432629.713451:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432629.713754:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588428032 00000100:00100000:2.0:1787432629.713763:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588428032 00010000:00010000:2.0:1787432629.713804:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33563f88c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5024 expref: 9 pid: 8806 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432629.713850:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 91 00000100:00100000:2.0:1787432629.713861:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304644e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2402:x1874258588428032:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432629.713878:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432629.713900:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33563f88c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5024 expref: 9 pid: 8806 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.713914:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33563f88c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5024 expref: 9 pid: 8806 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.713953:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432629.713958:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432629.713965:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ff627d3/0xca72b3b33563f8a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.713991:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ff627d3/0xca72b3b33563f8a1 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.714012:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432629.714202:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304644e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2402:x1874258588428032:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 342us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432629.714219:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 91 00010000:00010000:0.0:1787432629.717967:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33563f88c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5024 expref: 8 pid: 8806 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432629.718004:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874258609457152:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432629.718094:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001ff627d3/0xca72b3b33563f8a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.718801:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001ff627d3/0xca72b3b33563f8a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.718813:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ff627d3/0xca72b3b33563f8a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.718864:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001ff627d3/0xca72b3b33563f8a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.718873:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ff627d3/0xca72b3b33563f8a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.718882:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ff627d3/0xca72b3b33563f8a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.718889:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489e00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432629.718894:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ff627d3/0xca72b3b33563f8a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.718904:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ff627d3/0xca72b3b33563f8a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.718922:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ff627d3/0xca72b3b33563f8a1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.718930:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ff627d3/0xca72b3b33563f8a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432629.719113:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2403:x1874258588427904:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 9040us (9232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432629.719123:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 65 00000100:00100000:1.0:1787432629.721734:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432629.721827:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588428288 00000100:00100000:3.0:1787432629.721838:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588428288 00000100:00100000:3.0:1787432629.721934:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 201 00000100:00100000:3.0:1787432629.721945:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:12399:x1874258588428288:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787432629.722038:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1200/0xca72b3b33563f8a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.722056:0:10165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f6ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fad expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.722064:0:10165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1200/0xca72b3b33563f8a8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.722103:0:10165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f6ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fad expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.722117:0:10165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f6ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fad expref: 19 pid: 6514 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432629.722132:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609457280:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432629.722252:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483030150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432629.724454:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609457280:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432629.724484:0:10165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1200/0xca72b3b33563f8a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432629.725111:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432629.725798:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588428416 00000100:00100000:3.0:1787432629.725807:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588428416 00010000:00010000:3.0:1787432629.726096:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f6ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fad expref: 20 pid: 6514 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432629.726194:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 92 00000100:00100000:3.0:1787432629.726236:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304644a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:2403:x1874258588428416:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432629.726253:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432629.726262:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f6ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fad expref: 20 pid: 6514 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.726276:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f6ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fad expref: 20 pid: 6514 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.726299:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f6ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4fad expref: 20 pid: 6514 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.726315:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:3.0:1787432629.726320:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1200/0xca72b3b33563f8a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.726330:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1200/0xca72b3b33563f8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.726339:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1200/0xca72b3b33563f8a8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.726363:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432629.726418:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304644a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:2403:x1874258588428416:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 186us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432629.726425:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 92 00010000:00010000:0.0:1787432629.726859:0:10165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1200/0xca72b3b33563f8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.726867:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1200/0xca72b3b33563f8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.727052:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8af lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.727066:0:10165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f870 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d500f expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.727075:0:10165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8af lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.727117:0:10165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f870 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d500f expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.727130:0:10165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f870 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d500f expref: 19 pid: 6514 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432629.727144:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a46680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609457408:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787432629.727249:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787432629.730653:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432629.730778:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a46680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609457408:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432629.730807:0:10165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8af lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432629.730862:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588428544 00000100:00100000:3.0:1787432629.730870:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588428544 00010000:00010000:3.0:1787432629.730912:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f870 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d500f expref: 20 pid: 6514 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432629.730983:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 93 00000100:00100000:3.0:1787432629.730994:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304647100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:2403:x1874258588428544:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432629.731012:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432629.731020:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f870 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d500f expref: 20 pid: 6514 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.731041:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f870 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d500f expref: 20 pid: 6514 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.731067:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f870 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d500f expref: 20 pid: 6514 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.731082:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948411a7a400) 00010000:00010000:3.0:1787432629.731087:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8af lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.731096:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.731104:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8af lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.731123:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432629.731238:0:10165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.731244:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787432629.731344:0:10165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1787432629.731454:0:10165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1787432629.731489:0:10165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1787432629.731569:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a46680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10165:1874258609457536:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787432629.731618:0:10165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432629.731653:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432629.732201:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304647100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:2403:x1874258588428544:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 1205us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432629.732222:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 93 00000100:00100000:1.0:1787432629.733631:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609457536 00000100:00100000:1.0:1787432629.733644:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609457536 00000100:00100000:1.0:1787432629.733709:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787432629.733721:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10165:x1874258609457536:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787432629.733885:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10165:x1874258609457536:12345-0@lo:1000:mdt00_004.0 Request processed in 167us (2266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432629.733893:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787432629.734131:0:10165:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1787432629.734137:0:10165:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff948435b64a80, transno 4294967316 00000100:00100000:0.0:1787432629.734382:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a46680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10165:1874258609457536:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1787432629.734530:0:10165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1787432629.734600:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a46680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10165:1874258609457664:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787432629.734641:0:10165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432629.734746:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609457664 00000100:00100000:1.0:1787432629.734752:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609457664 00000100:00100000:1.0:1787432629.734791:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787432629.734799:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10165:x1874258609457664:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787432629.734908:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10165:x1874258609457664:12345-0@lo:1000:mdt00_004.0 Request processed in 110us (265us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787432629.734915:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787432629.734991:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787432629.735012:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a46680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10165:1874258609457664:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1787432629.735060:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.735071:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8af lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.735079:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.735085:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432629.735090:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.735098:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8af lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.735116:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948411a7a400) 00010000:00010000:0.0:1787432629.735119:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787432629.735123:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8af lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.735129:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8af lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.735153:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.735388:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7eb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.735395:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7eb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.735400:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432629.735404:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7eb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.735410:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7eb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.735419:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:0.0:1787432629.735421:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787432629.735424:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7eb lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.735429:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1400/0xca72b3b33563f7eb lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.735452:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f8b6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.735465:0:10165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f807 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ff3 expref: 22 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.735473:0:10165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f8b6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.735496:0:10165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f807 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ff3 expref: 22 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432629.735514:0:10165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f807 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ff3 expref: 22 pid: 10165 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432629.735525:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a44000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609457792:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787432629.735589:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787432629.738693:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432629.738766:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588428672 00000100:00100000:3.0:1787432629.738783:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588428672 00010000:00010000:3.0:1787432629.738821:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f807 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ff3 expref: 23 pid: 10165 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432629.738868:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 94 00000100:00100000:3.0:1787432629.738878:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:2403:x1874258588428672:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432629.738895:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432629.738901:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f807 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ff3 expref: 23 pid: 10165 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.738915:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f807 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ff3 expref: 23 pid: 10165 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.738937:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:3.0:1787432629.738942:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f8b6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.738951:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f8b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.738959:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f8b6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432629.738986:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432629.739046:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:2403:x1874258588428672:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 168us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432629.739053:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 94 00010000:00010000:1.0:1787432629.739411:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563f807 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ff3 expref: 22 pid: 10165 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432629.739428:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a44000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609457792:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432629.739447:0:10165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f8b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.739454:0:10165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f8b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.739459:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f8b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.739479:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f8b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.739487:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f8b6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.739493:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f8b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.739499:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432629.739503:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f8b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.739510:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f8b6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.739519:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:1.0:1787432629.739522:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432629.739526:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f8b6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.739531:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33563f8b6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.739542:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1200/0xca72b3b33563f8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.739548:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1200/0xca72b3b33563f8a8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.739553:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1200/0xca72b3b33563f8a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.739565:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432629.739568:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1200/0xca72b3b33563f8a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.739574:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1200/0xca72b3b33563f8a8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.739581:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483026f7600) 00010000:00010000:1.0:1787432629.739584:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787432629.739587:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1200/0xca72b3b33563f8a8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.739592:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1200/0xca72b3b33563f8a8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432629.739856:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:12399:x1874258588428288:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 17912us (18188us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787432629.739865:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 201 00000020:00080000:1.0:1787432629.739870:0:10165:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787432629.742726:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432629.742796:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588428928 00000100:00100000:2.0:1787432629.742805:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588428928 00000100:00100000:2.0:1787432629.742858:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 50 00000100:00100000:2.0:1787432629.742869:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948411a1d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:12399:x1874258588428928:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787432629.743126:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787432629.743157:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1787432629.743226:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f8bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.743243:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f8bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.743254:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f8bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.743280:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f8bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.743286:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f8bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.743293:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f8bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432629.743311:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787432629.743420:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948411a1d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:12399:x1874258588428928:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 549us (701us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787432629.743428:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 50 00000020:00080000:2.0:1787432629.743433:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787432629.743615:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432629.743621:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f8bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.743629:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432629.743632:0:9519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f8bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.743639:0:9519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f8bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.743656:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948411a7a400) 00010000:00010000:1.0:1787432629.743659:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787432629.743664:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f8bd lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.743670:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f8bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432629.743681:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432629.743683:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432629.743684:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787432629.745587:0:13810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787432629.745595:0:13810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787432629.746413:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1787432629.746430:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787432629.785866:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432629.785926:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432629.785964:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432629.786005:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432629.786036:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588429568 00000100:00100000:1.0:1787432629.786045:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588429568 00000100:00100000:1.0:1787432629.786102:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588429184 00000100:00100000:1.0:1787432629.786106:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588429184 00000100:00100000:1.0:1787432629.786130:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 357 00000100:00100000:1.0:1787432629.786140:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2403:x1874258588429568:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432629.786260:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2403:x1874258588429568:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 121us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432629.786268:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 357 00000100:00100000:1.0:1787432629.786287:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 358 00000100:00100000:1.0:1787432629.786294:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588429184:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432629.786317:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2402:x1874258588429184:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432629.786338:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 358 00000100:00100000:1.0:1787432629.786379:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432629.786877:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588429056 00000100:00100000:3.0:1787432629.786882:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588429056 00000100:00100000:3.0:1787432629.786922:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 397 00000100:00100000:3.0:1787432629.786929:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:2403:x1874258588429056:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432629.786958:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:2403:x1874258588429056:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432629.786965:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 397 00000100:00080000:0.0:1787432629.786995:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787432629.787015:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588429440 00000100:00100000:0.0:1787432629.787020:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588429440 00000100:00100000:3.0:1787432629.787088:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 359 00000100:00080000:1.0:1787432629.787092:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432629.787097:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588429440:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432629.787139:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588429312 00000100:00100000:2.0:1787432629.787145:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588429312 00000100:00100000:2.0:1787432629.787195:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 101 00000100:00100000:2.0:1787432629.787203:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2403:x1874258588429312:12345-192.168.204.24@tcp:400:kworker.0 00000100:00080000:1.0:1787432629.787273:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432629.787460:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2402:x1874258588429440:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 363us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432629.787467:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 359 00000100:00100000:3.0:1787432629.791025:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2403:x1874258588429312:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 3811us (5086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432629.791041:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 101 00010000:00010000:0.0:1787432630.475457:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432631.499771:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787432631.543536:0:14669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787432631.543549:0:14669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787432631.543584:0:14669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787432631.543591:0:14669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787432631.690108:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432631.690219:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588429824 00000100:00100000:0.0:1787432631.690230:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588429824 00000100:00100000:0.0:1787432631.690298:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 202 00000100:00100000:0.0:1787432631.690309:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:12417:x1874258588429824:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787432631.690347:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432631.690376:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f8c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d502b expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.690508:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8cb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.690524:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.690550:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432631.690562:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787432631.690671:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f8c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d502b expref: 26 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.690689:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d502b expref: 25 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.690699:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:0.0:1787432631.690702:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787432631.690706:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304489000, rc 0) 00000100:00100000:0.0:1787432631.690772:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+25:12417:x1874258588429824:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 464us (674us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787432631.690780:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 202 00000100:00080000:3.0:1787432631.691541:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432631.697582:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432631.697986:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588429952 00000100:00100000:1.0:1787432631.697997:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588429952 00000100:00100000:1.0:1787432631.698066:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 203 00000100:00100000:1.0:1787432631.698078:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+25:12417:x1874258588429952:12345-192.168.204.24@tcp:34:lfs.0 00010000:00010000:1.0:1787432631.698156:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f8d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698209:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f8d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698222:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f8d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698239:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f8e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698246:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f8e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698252:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f8e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698456:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f8e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698465:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698472:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787432631.698517:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698531:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f8d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698539:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f8d9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698546:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f8d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698552:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432631.698556:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f8d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698564:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f8d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698577:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:1.0:1787432631.698580:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432631.698584:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f8d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698597:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f8d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698610:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f8e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698616:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f8e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698623:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f8e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698628:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432631.698631:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f8e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698637:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f8e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698645:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9483032adb00) 00010000:00010000:1.0:1787432631.698647:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432631.698649:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f8e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698654:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f8e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698667:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698673:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f8e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698684:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f8e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698690:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432631.698692:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f8e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698699:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f8e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698706:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9483032ada00) 00010000:00010000:1.0:1787432631.698709:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432631.698712:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f8e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.698718:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563f8e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432631.698849:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+25:12417:x1874258588429952:12345-192.168.204.24@tcp:34:lfs.0 Request processed in 770us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432631.698859:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 203 00000001:00080000:2.0:1787432631.765687:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1787432631.765703:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:0.0:1787432631.768139:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432631.768464:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588430208 00000100:00100000:3.0:1787432631.768475:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588430208 00000100:00100000:3.0:1787432631.768541:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 204 00000100:00100000:3.0:1787432631.768552:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+25:12420:x1874258588430208:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432631.768582:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432631.768606:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563f8ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5032 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.768689:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f8f5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.768724:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f8f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.768736:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f8f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.768752:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f8fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.768759:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f8fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.768766:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f8fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769038:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f903 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769047:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769054:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432631.769064:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787432631.769141:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f8f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769149:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f8f5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769156:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f8f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769290:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432631.769294:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f8f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769302:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f8f5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769316:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:3.0:1787432631.769319:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432631.769324:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f8f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769330:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f8f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769344:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f8fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769349:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f8fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769355:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f8fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769360:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1a00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432631.769363:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f8fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769370:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f8fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769388:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948435957f00) 00010000:00010000:3.0:1787432631.769391:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432631.769394:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f8fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769400:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f8fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769443:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563f8ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5032 expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769457:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f903 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5032 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432631.769464:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948435957b00) 00010000:00010000:3.0:1787432631.769466:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432631.769468:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f0c00, rc 0) 00000100:00100000:3.0:1787432631.769536:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:12420:x1874258588430208:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 984us (1406us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787432631.769545:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 204 00000100:00100000:3.0:1787432631.775339:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432631.775801:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588430336 00000100:00100000:0.0:1787432631.775811:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588430336 00000100:00100000:0.0:1787432631.775982:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 205 00000100:00100000:0.0:1787432631.775993:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:12420:x1874258588430336:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:0.0:1787432631.776060:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f911 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.776076:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.776087:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.776137:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.776145:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f911 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.776153:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f911 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.776160:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432631.776213:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f911 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.776222:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f911 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.776236:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948435957b00) 00010000:00010000:0.0:1787432631.776239:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787432631.776244:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f911 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.776251:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f911 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432631.776326:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:12420:x1874258588430336:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 333us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432631.776334:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 205 00000100:00100000:2.0:1787432631.778652:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432631.778771:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588430592 00000100:00100000:3.0:1787432631.778780:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588430592 00000100:00100000:3.0:1787432631.778845:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 51 00000100:00100000:3.0:1787432631.778856:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830443d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:12420:x1874258588430592:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:3.0:1787432631.779071:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830443d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+28:12420:x1874258588430592:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 216us (430us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1787432631.779094:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 51 00000100:00100000:3.0:1787432631.827292:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432631.827464:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588430848 00000100:00100000:2.0:1787432631.827475:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588430848 00000100:00100000:2.0:1787432631.827536:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 206 00000100:00100000:2.0:1787432631.827547:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+28:11943:x1874258588430848:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787432631.827574:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432631.827598:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f918 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5039 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.827735:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f91f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.827753:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f903 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5032 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.827764:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f91f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.827803:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f903 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5032 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.827818:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f903 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5032 expref: 29 pid: 6513 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432631.827845:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874258609457920:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432631.827970:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff948412a70cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432631.832488:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432631.832645:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588430976 00000100:00100000:0.0:1787432631.832655:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588430976 00010000:00010000:0.0:1787432631.832699:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f903 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5032 expref: 30 pid: 6513 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432631.832757:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 95 00000100:00100000:0.0:1787432631.832768:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:2402:x1874258588430976:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432631.832784:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432631.832791:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f903 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5032 expref: 30 pid: 6513 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.832805:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f903 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5032 expref: 30 pid: 6513 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.832842:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948435957b00) 00010000:00010000:0.0:1787432631.832847:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f91f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.832857:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f91f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.832864:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f91f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.832884:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432631.832955:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:2402:x1874258588430976:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 188us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432631.832963:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 95 00010000:00010000:2.0:1787432631.834222:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f903 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5032 expref: 29 pid: 6513 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432631.834249:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6515:1874258609457920:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432631.834275:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f91f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.834287:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f91f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.834324:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f91f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432631.834344:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787432631.834481:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f918 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5039 expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.834497:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f91f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5039 expref: 29 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.834506:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948435957b00) 00010000:00010000:2.0:1787432631.834510:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787432631.834512:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85f200, rc 0) 00000100:00100000:2.0:1787432631.834572:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+29:11943:x1874258588430848:12345-192.168.204.24@tcp:101:bash.0 Request processed in 7025us (7291us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1787432631.834581:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 206 00000100:00100000:3.0:1787432631.838401:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432631.838560:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588431104 00000100:00100000:1.0:1787432631.838573:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588431104 00000100:00100000:1.0:1787432631.838649:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 207 00000100:00100000:1.0:1787432631.838661:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+29:11943:x1874258588431104:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787432631.838690:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432631.838714:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f92d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5040 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.838775:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f934 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.838789:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f934 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.838800:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f934 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.838922:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f92d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5040 expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.838950:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f934 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5040 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432631.838961:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948435957b00) 00010000:00010000:1.0:1787432631.838964:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787432631.838968:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851c00, rc 0) 00000100:00100000:1.0:1787432631.839037:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:11943:x1874258588431104:12345-192.168.204.24@tcp:101:bash.0 Request processed in 379us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432631.839044:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 207 00000100:00100000:3.0:1787432631.843659:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432631.843770:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588431360 00000100:00100000:0.0:1787432631.843781:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588431360 00000100:00100000:0.0:1787432631.843845:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 208 00000100:00100000:0.0:1787432631.843856:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:11943:x1874258588431360:12345-192.168.204.24@tcp:36:bash.0 00010000:00010000:0.0:1787432631.844120:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f93b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.844140:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f93b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.844151:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f93b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787432631.844255:0:9020:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1787432631.844277:0:9020:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000431bfb66 reply state 00000000f79bfb7c transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f93b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.844289:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f93b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432631.844297:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948435957b00) 00010000:00010000:0.0:1787432631.844299:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787432631.844303:0:9020:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787432631.844351:0:9020:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1787432631.844449:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+34:11943:x1874258588431360:12345-192.168.204.24@tcp:36:bash.0 Request processed in 593us (801us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787432631.844456:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 208 00000020:00080000:0.0:1787432631.844461:0:9020:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787432631.847655:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432631.847765:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588431488 00000100:00100000:2.0:1787432631.847775:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588431488 00000100:00100000:2.0:1787432631.847845:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 209 00000100:00100000:2.0:1787432631.847856:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+34:11943:x1874258588431488:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787432631.847886:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432631.847906:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f942 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5047 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.847973:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f942 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5047 expref: 35 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.848011:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f942 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5047 expref: 35 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.848032:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948435957b00) 00010000:00010000:2.0:1787432631.848035:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787432631.848038:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e200, rc 0) 00000100:00100000:2.0:1787432631.848097:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+35:11943:x1874258588431488:12345-192.168.204.24@tcp:101:bash.0 Request processed in 243us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432631.848103:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 209 00000100:00100000:3.0:1787432631.851626:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432631.851783:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588431616 00000100:00100000:2.0:1787432631.851797:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588431616 00000100:00100000:2.0:1787432631.851884:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 66 00000100:00100000:2.0:1787432631.851896:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:11943:x1874258588431616:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787432631.851916:0:8806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432631.851951:0:8806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f949 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d504e expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787432631.851981:0:8806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8a0eb3, atime: 0x6a8a0eb1, ctime: 0x6a8a0eb3, blocks: 0x8 00010000:00010000:2.0:1787432631.852006:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=442s v=(0 0) 00010000:00010000:2.0:1787432631.852010:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432631.852018:0:8806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f949 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d504e expref: 8 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.852034:0:8806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f949 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d504e expref: 8 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.852072:0:8806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85fc00, rc 0) 00000100:00100000:2.0:1787432631.852147:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:11943:x1874258588431616:12345-192.168.204.24@tcp:101:bash.0 Request processed in 253us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432631.852155:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 66 00000100:00080000:3.0:1787432631.852963:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432631.855302:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432631.855603:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588431744 00000100:00100000:0.0:1787432631.855614:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588431744 00002000:00010000:0.0:1787432631.855670:0:8437:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1787432631.855675:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948304568380 with x1874258588431744 ext(0->18446744073709551615) 00002000:00010000:0.0:1787432631.855689:0:8437:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948304568380. 00000100:00100000:0.0:1787432631.855725:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 5 00000100:00100000:0.0:1787432631.855735:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2403:x1874258588431744:12345-192.168.204.24@tcp:10:bash.0 00002000:00010000:0.0:1787432631.856265:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787432631.856269:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787432627 -> 1787432631 00002000:00010000:0.0:1787432631.856272:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1787432625 -> 1787432625 00002000:00010000:0.0:1787432631.856274:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787432627 -> 1787432631 00002000:00010000:0.0:1787432631.856277:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1787432631.856646:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2403:x1874258588431744:12345-192.168.204.24@tcp:10:bash.0 Request processed in 908us (1349us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787432631.856656:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 5 00002000:00010000:0.0:1787432631.856662:0:8437:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1787432631.856665:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948304568380 with x1874258588431744 ext(0->18446744073709551615) 00002000:00010000:0.0:1787432631.856672:0:8437:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948304568380. 00000100:00100000:0.0:1787432631.947374:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432631.947638:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588431872 00000100:00100000:2.0:1787432631.947648:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588431872 00000100:00100000:2.0:1787432631.947712:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 210 00000100:00100000:2.0:1787432631.947723:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+35:12434:x1874258588431872:12345-192.168.204.24@tcp:34:lfs.0 00010000:00010000:2.0:1787432631.947794:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f950 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.947812:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f950 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.947826:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f950 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.947841:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f957 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.947847:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f957 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.947853:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f957 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.947941:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f95e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.947969:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f95e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.947976:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f95e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432631.948157:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f95e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948210:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f950 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948217:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f950 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948223:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f950 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948229:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ee00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432631.948233:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f950 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948241:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f950 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948253:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:2.0:1787432631.948256:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432631.948261:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f950 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948267:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f950 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948288:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f957 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948294:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f957 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948300:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f957 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948306:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ea00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432631.948308:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f957 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948315:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f957 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948324:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948411a6b400) 00010000:00010000:2.0:1787432631.948326:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432631.948330:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f957 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948336:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f957 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948350:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f95e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948357:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f95e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948362:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f95e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948373:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fa00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432631.948376:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f95e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948383:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f95e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948391:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948435957b00) 00010000:00010000:2.0:1787432631.948393:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432631.948396:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f95e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432631.948402:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563f95e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432631.948486:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+35:12434:x1874258588431872:12345-192.168.204.24@tcp:34:lfs.0 Request processed in 764us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432631.948494:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 210 00000100:00100000:3.0:1787432632.015833:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432632.015956:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588432128 00000100:00100000:1.0:1787432632.015967:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588432128 00000100:00100000:1.0:1787432632.016044:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 211 00000100:00100000:1.0:1787432632.016056:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+35:12437:x1874258588432128:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787432632.016077:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432632.016097:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f965 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5055 expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016237:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f96c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016252:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f96c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016263:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f96c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016278:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f973 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016285:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016291:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016394:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f97a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016403:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f97a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016410:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f97a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432632.016418:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787432632.016491:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f96c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016508:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f96c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016515:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f96c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016521:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432632.016525:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f96c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016532:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f96c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016545:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:1.0:1787432632.016548:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432632.016553:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f96c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016558:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563f96c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016570:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016575:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f973 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016580:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f973 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016585:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851a00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432632.016593:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f973 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016598:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f973 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016605:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9483032ada00) 00010000:00010000:1.0:1787432632.016607:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432632.016610:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f973 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016615:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563f973 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016651:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563f965 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5055 expref: 38 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016664:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f97a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5055 expref: 37 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.016671:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948435957b00) 00010000:00010000:1.0:1787432632.016672:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787432632.016675:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850e00, rc 0) 00000100:00100000:1.0:1787432632.016740:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+37:12437:x1874258588432128:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 686us (919us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787432632.016747:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 211 00000100:00100000:3.0:1787432632.021057:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432632.021152:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588432256 00000100:00100000:1.0:1787432632.021162:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588432256 00000100:00100000:1.0:1787432632.021252:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 212 00000100:00100000:1.0:1787432632.021262:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+37:12437:x1874258588432256:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:1.0:1787432632.021345:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f988 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.021364:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f91f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5039 expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.021374:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f988 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.021414:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f91f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5039 expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.021428:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f91f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5039 expref: 37 pid: 6515 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432632.021442:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304460000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1874258609458048:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432632.021530:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432632.025266:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432632.025372:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304460000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6513:1874258609458048:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432632.025400:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f988 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432632.025470:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588432512 00000100:00100000:3.0:1787432632.025477:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588432512 00000100:00100000:3.0:1787432632.025535:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00100000:3.0:1787432632.025545:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+38:6171:x1874258588432512:12345-192.168.204.24@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787432632.025839:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+39:6171:x1874258588432512:12345-192.168.204.24@tcp:35:ldlm_bl.0 Request processed in 294us (582us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787432632.025847:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00100000:3.0:1787432632.028343:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432632.028459:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588432640 00000100:00100000:1.0:1787432632.028470:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588432640 00010000:00010000:1.0:1787432632.028512:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f91f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5039 expref: 39 pid: 6515 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432632.028552:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 96 00000100:00100000:1.0:1787432632.028562:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94841223c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+39:2402:x1874258588432640:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432632.028596:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432632.028603:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f91f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5039 expref: 39 pid: 6515 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.028617:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f91f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5039 expref: 39 pid: 6515 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.028651:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563f91f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5039 expref: 39 pid: 6515 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.028668:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948435957b00) 00010000:00010000:1.0:1787432632.028673:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f988 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.028684:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f988 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.028692:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f988 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.028724:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432632.028787:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94841223c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+38:2402:x1874258588432640:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 225us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432632.028796:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 96 00010000:00010000:3.0:1787432632.029240:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f988 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.029250:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f988 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.029295:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f988 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.029315:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f988 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.029321:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f988 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.029327:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432632.029331:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f988 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.029338:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f988 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.029349:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948435957b00) 00010000:00010000:3.0:1787432632.029352:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432632.029356:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f988 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.029361:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563f988 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432632.029420:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+37:12437:x1874258588432256:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 8159us (8372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432632.029428:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 212 00000100:00100000:3.0:1787432632.032376:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432632.032526:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588432896 00000100:00100000:2.0:1787432632.032538:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588432896 00000100:00100000:2.0:1787432632.032598:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 53 00000100:00100000:2.0:1787432632.032610:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+37:12437:x1874258588432896:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:2.0:1787432632.032871:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+38:12437:x1874258588432896:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 263us (505us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787432632.032879:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 53 00000100:00100000:1.0:1787432632.131446:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432632.131606:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588433152 00000100:00100000:2.0:1787432632.131617:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588433152 00000100:00100000:2.0:1787432632.131678:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 213 00000100:00100000:2.0:1787432632.131706:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+38:12448:x1874258588433152:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787432632.131744:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432632.131766:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f98f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d505c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.132027:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f996 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.132044:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f996 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.132055:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f996 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.132069:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f99d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.132076:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f99d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.132083:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f99d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.135571:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f9a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.135598:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.135614:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432632.135706:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787432632.135948:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f996 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.135957:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f996 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.135985:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f996 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.135991:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ee00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432632.135996:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f996 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.136004:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f996 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.136018:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:0.0:1787432632.136033:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432632.136040:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f996 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.136046:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f996 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.136062:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f99d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.136068:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f99d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.136074:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f99d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.136079:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432632.136081:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f99d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.136097:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f99d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.136106:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948411a6b400) 00010000:00010000:0.0:1787432632.136108:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432632.136111:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f99d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.136117:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f99d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.136433:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f98f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d505c expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.136451:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f9a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d505c expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.136459:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948435957b00) 00010000:00010000:0.0:1787432632.136461:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432632.136464:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304488800, rc 0) 00000100:00100000:0.0:1787432632.136548:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+40:12448:x1874258588433152:12345-192.168.204.24@tcp:101:cat.0 Request processed in 4844us (5122us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787432632.136557:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 213 00000100:00100000:0.0:1787432632.145244:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432632.145452:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588433408 00000100:00100000:2.0:1787432632.145462:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588433408 00000100:00100000:2.0:1787432632.145523:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 54 00000100:00100000:2.0:1787432632.145535:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+40:12448:x1874258588433408:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:2.0:1787432632.146146:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+41:12448:x1874258588433408:12345-192.168.204.24@tcp:35:cat.0 Request processed in 612us (910us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787432632.146155:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 54 00000100:00100000:1.0:1787432632.202745:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432632.202849:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588433664 00000100:00100000:2.0:1787432632.202859:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588433664 00000100:00100000:2.0:1787432632.202933:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 214 00000100:00100000:2.0:1787432632.202944:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+41:12449:x1874258588433664:12345-192.168.204.24@tcp:36:rm.0 00010000:00010000:2.0:1787432632.203041:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787432632.203072:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563f942 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5047 expref: 41 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.203095:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33563f9a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d505c expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.203108:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563f97a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5055 expref: 39 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.203120:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851c00/0xca72b3b33563f934 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5040 expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.203132:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948435957b00) 00010000:00010000:2.0:1787432632.203138:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432632.203226:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f9b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.203240:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f9b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.203250:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f9b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.203267:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f9b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.203289:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f9b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.203297:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f9b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.203377:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f9c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.203386:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f9c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.203392:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f9c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787432632.204043:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1787432632.204054:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 443295888893ns, next at 444295886506ns, rc = 0 00010000:00010000:2.0:1787432632.204102:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f9c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204112:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204119:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204126:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f9c7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204132:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f9c7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204148:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f9c7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204442:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432632.204466:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f9c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204473:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f9c0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204480:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f9c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204485:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432632.204490:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f9c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204497:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f9c0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204508:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948435957b00) 00010000:00010000:2.0:1787432632.204511:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787432632.204514:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f9c0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204520:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563f9c0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204537:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f9b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204544:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f9b2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204556:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f9b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204731:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432632.204735:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f9b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204741:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f9b2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204750:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:2.0:1787432632.204752:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432632.204756:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f9b2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204762:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563f9b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432632.204772:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b137c883 reply state 0000000037342f0c transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f9b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204783:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f9b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.204789:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948411a6b000) 00010000:00010000:2.0:1787432632.204791:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787432632.204794:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787432632.204919:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+39:12449:x1874258588433664:12345-192.168.204.24@tcp:36:rm.0 Request processed in 1973us (2359us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787432632.204939:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 214 00010000:00010000:0.0:1787432632.206054:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432632.206067:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f9c7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.206093:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ee00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432632.206098:0:9519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f9c7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.206105:0:9519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f9c7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.206118:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948435957b00) 00010000:00010000:0.0:1787432632.206121:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787432632.206125:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f9c7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.206129:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b33563f9c7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.206141:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432632.206143:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432632.206145:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432632.267959:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609458176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432632.268065:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432632.268502:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432632.268514:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948408b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609458304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432632.268554:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432632.269032:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609458176 00000100:00100000:0.0:1787432632.269043:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609458176 00000100:00100000:0.0:1787432632.269121:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787432632.269131:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609458176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787432632.269158:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432632.269248:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609458176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432632.269255:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787432632.269467:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609458304 00000100:00100000:2.0:1787432632.269474:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609458304 00000100:00100000:2.0:1787432632.269516:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787432632.269524:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609458304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787432632.269550:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787432632.269599:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609458304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432632.269605:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787432632.269845:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432632.269856:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609458432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432632.269893:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787432632.269998:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432632.270038:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948408b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609458304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432632.270057:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609458176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432632.270740:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609458432 00000100:00100000:0.0:1787432632.270750:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609458432 00000100:00100000:0.0:1787432632.270814:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787432632.270841:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609458432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432632.270863:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432632.270936:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609458432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432632.270943:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787432632.271045:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:2.0:1787432632.271053:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:2.0:1787432632.271071:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9483039b6d80, transno 4294967308 00000100:00100000:2.0:1787432632.271089:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609458432:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787432632.271249:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432632.301416:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432632.301766:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588433920 00000100:00100000:3.0:1787432632.301790:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588433920 00000100:00100000:3.0:1787432632.301889:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 215 00000100:00100000:3.0:1787432632.301901:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+39:12455:x1874258588433920:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787432632.301934:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432632.301954:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563f9ce lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5063 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.302063:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f9d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.302078:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f9d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.302090:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f9d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.302101:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f9dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.302109:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f9dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.302116:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f9dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787432632.302966:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787432632.303388:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f9e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.303402:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.303426:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.303462:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f9d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.303470:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f9d5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.303478:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f9d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.303484:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1a00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432632.303489:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f9d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.303496:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f9d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.303510:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:3.0:1787432632.303513:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432632.303517:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f9d5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.303524:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563f9d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432632.303541:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000114c1b80 reply state 00000000c7d3b25e transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f9dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.303553:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f9dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.303691:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948411a6b000) 00010000:00010000:3.0:1787432632.303693:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787432632.303696:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787432632.303730:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563f9ce lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5063 expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.303746:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f9e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5063 expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.303755:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948435957f00) 00010000:00010000:3.0:1787432632.303757:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432632.303760:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f0c00, rc 0) 00000100:00100000:3.0:1787432632.303840:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+42:12455:x1874258588433920:12345-192.168.204.24@tcp:101:bash.0 Request processed in 1941us (2433us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787432632.303849:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 215 00000100:00100000:2.0:1787432632.308121:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432632.308547:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588434048 00000100:00100000:3.0:1787432632.308675:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588434048 00000100:00100000:3.0:1787432632.308797:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 67 00000100:00100000:3.0:1787432632.308809:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588434048:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787432632.308829:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432632.308851:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563f9f1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d506a expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432632.308878:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432632.308898:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1787432632.308904:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432632.308936:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563f9f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d506a expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.308957:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563f9f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d506a expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.308971:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f1200, rc 0) 00000100:00100000:3.0:1787432632.309037:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2401:x1874258588434048:12345-192.168.204.24@tcp:101:bash.0 Request processed in 230us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432632.309045:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 67 00000100:00080000:1.0:1787432632.312810:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432632.313245:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432632.313454:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588434176 00000100:00100000:3.0:1787432632.313464:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588434176 00000100:00100000:3.0:1787432632.313514:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 68 00000100:00100000:3.0:1787432632.313524:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948408b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:12455:x1874258588434176:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787432632.313541:0:8806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432632.313573:0:8806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563f9f8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5071 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.313605:0:8806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563f9f1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d506a expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.313615:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432632.313629:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432632.313635:0:8806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563f9f8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5071 expref: 7 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.313676:0:8806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563f9f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d506a expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.313710:0:8806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563f9f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d506a expref: 7 pid: 8432 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432632.313727:0:8806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304569f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8806:1874258609458560:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432632.313829:0:8806:0:(client.c:2715:ptlrpc_set_wait()) set ffff948304743cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432632.317004:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432632.317132:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588434304 00000100:00100000:2.0:1787432632.317144:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588434304 00010000:00010000:2.0:1787432632.317224:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563f9f1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d506a expref: 8 pid: 8432 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432632.317229:0:8806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304569f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8806:1874258609458560:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432632.317258:0:8806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563f9f8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5071 expref: 8 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432632.317261:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 97 00000100:00100000:2.0:1787432632.317270:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2403:x1874258588434304:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432632.317275:0:8806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f1400, rc 0) 00010000:00010000:2.0:1787432632.317284:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432632.317305:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563f9f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d506a expref: 8 pid: 8432 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.317317:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563f9f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d506a expref: 8 pid: 8432 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432632.317345:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948408b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:12455:x1874258588434176:12345-192.168.204.24@tcp:101:bash.0 Request processed in 3823us (4108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432632.317352:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 68 00010000:00010000:2.0:1787432632.317359:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563f9f1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d506a expref: 8 pid: 8432 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.317374:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432632.317378:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432632.317387:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563f9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5071 expref: 6 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.317396:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563f9f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5071 expref: 6 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.317432:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563f9f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5071 expref: 6 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432632.317446:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304434a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6499:1874258609458688:192.168.204.24@tcp:105: 00000100:00100000:2.0:1787432632.317504:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff948412a70cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432632.322066:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432632.322474:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588434560 00000100:00100000:1.0:1787432632.322484:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588434560 00000100:00100000:1.0:1787432632.322548:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 55 00000100:00100000:1.0:1787432632.322560:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+42:12455:x1874258588434560:12345-192.168.204.24@tcp:35:bash.0 00000001:00080000:1.0:1787432632.322809:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967485 00000100:00100000:1.0:1787432632.322920:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+44:12455:x1874258588434560:12345-192.168.204.24@tcp:35:bash.0 Request processed in 361us (863us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1787432632.322942:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 55 00000020:00080000:1.0:1787432632.322948:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787432632.323532:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304434a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6499:1874258609458688:192.168.204.24@tcp:105: 00010000:00010000:0.0:1787432632.323559:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432632.323588:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2403:x1874258588434304:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 6318us (6594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432632.323597:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 97 00000100:00100000:1.0:1787432632.519853:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432632.519967:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588434688 00000100:00100000:0.0:1787432632.519977:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588434688 00000100:00100000:0.0:1787432632.520049:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 216 00000100:00100000:0.0:1787432632.520060:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94841de5d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+44:12472:x1874258588434688:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787432632.520083:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432632.520102:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f9ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5078 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.520211:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fa06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.520226:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fa06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.520237:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fa06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432632.520296:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787432632.520300:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787432632.520319:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fa06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.520344:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563f9ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5078 expref: 46 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.520363:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fa06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5078 expref: 45 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.520372:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:0.0:1787432632.520375:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787432632.520378:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304488e00, rc 0) 00000100:00100000:0.0:1787432632.520857:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94841de5d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+45:12472:x1874258588434688:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 795us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432632.520865:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 216 00010000:00010000:0.0:1787432632.524331:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432632.526812:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432632.526901:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588434944 00000100:00100000:2.0:1787432632.526910:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588434944 00000100:00100000:2.0:1787432632.526987:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 217 00000100:00100000:2.0:1787432632.526999:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+45:12472:x1874258588434944:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432632.527409:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432632.527444:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fa0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d507f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.527572:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fa14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.527586:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fa14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.527597:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fa14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432632.527607:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787432632.527723:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fa0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d507f expref: 48 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.527743:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fa14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d507f expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.527751:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948435957f00) 00010000:00010000:2.0:1787432632.527755:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432632.527759:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e200, rc 0) 00000100:00100000:2.0:1787432632.527879:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+47:12472:x1874258588434944:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 881us (1077us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1787432632.527887:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 217 00000100:00100000:2.0:1787432632.534257:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432632.534305:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432632.534398:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588435328 00000100:00100000:1.0:1787432632.534409:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588435328 00000100:00100000:1.0:1787432632.534487:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00100000:1.0:1787432632.534498:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+47:2401:x1874258588435328:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432632.534513:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432632.534537:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fa14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d507f expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.534572:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948435957f00) 00010000:00010000:1.0:1787432632.534578:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432632.534653:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+46:2401:x1874258588435328:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 158us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432632.534662:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00100000:3.0:1787432632.536765:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588435200 00000100:00100000:3.0:1787432632.536779:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588435200 00000100:00100000:3.0:1787432632.536863:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 218 00000100:00100000:3.0:1787432632.536875:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+46:12472:x1874258588435200:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432632.536898:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432632.536930:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563fa22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5086 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.537043:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563fa29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.537075:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563fa29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.537086:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563fa29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432632.537100:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787432632.537254:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563fa22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5086 expref: 49 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.537273:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563fa29 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5086 expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.537283:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948435957f00) 00010000:00010000:3.0:1787432632.537286:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787432632.537290:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f1a00, rc 0) 00000100:00100000:3.0:1787432632.537357:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+48:12472:x1874258588435200:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 484us (3109us total) trans 4294967488 rc 0/0 00000100:00100000:3.0:1787432632.537365:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 218 00000100:00100000:2.0:1787432632.557558:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432632.559574:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588435456 00000100:00100000:0.0:1787432632.559595:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588435456 00000100:00100000:0.0:1787432632.560388:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 69 00000100:00100000:0.0:1787432632.560401:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+6:2402:x1874258588435456:12345-192.168.204.24@tcp:1:lfs.0 00010000:00010000:0.0:1787432632.560460:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e4b4591/0xca72b3b33563fa37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.560485:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563f9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5071 expref: 6 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.560512:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432632.560517:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432632.560522:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e4b4591/0xca72b3b33563fa37 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.560566:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563f9f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5071 expref: 6 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.560582:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563f9f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5071 expref: 6 pid: 8806 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.560596:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1874258609458816:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787432632.561934:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787432632.568455:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1874258609458816:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432632.568489:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001e4b4591/0xca72b3b33563fa37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432632.570694:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432632.570970:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588435584 00000100:00100000:3.0:1787432632.570982:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588435584 00002000:00100000:3.0:1787432632.571037:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff948435b67800 x1874258588435584/t0(0) o4->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:343/0 lens 504/0 e 0 to 0 dl 1787432643 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787432632.571048:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948435b67800 with x1874258588435584 ext(0->8) 00010000:00010000:3.0:1787432632.571057:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563f9f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5071 expref: 7 pid: 8806 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.571092:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563f9f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5071 expref: 7 pid: 8806 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432632.571101:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff948435b67800 00000100:00100000:3.0:1787432632.571140:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:3.0:1787432632.571151:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2402:x1874258588435584:12345-192.168.204.24@tcp:4:lfs.0 00000100:00100000:3.0:1787432632.572639:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2402:x1874258588435584:12345-192.168.204.24@tcp:4:lfs.0 Request processed in 1482us (1950us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787432632.572651:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 3 00002000:00100000:3.0:1787432632.572661:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff948435b67800 x1874258588435584/t4294967309(0) o4->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:343/0 lens 504/448 e 0 to 0 dl 1787432643 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787432632.572669:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948435b67800 with x1874258588435584 ext(0->8) 00010000:00010000:3.0:1787432632.572678:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563f9f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5071 expref: 9 pid: 8806 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.572694:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563f9f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5071 expref: 9 pid: 8806 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432632.572702:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff948435b67800 00000100:00100000:2.0:1787432632.578120:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432632.578355:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588435712 00000100:00100000:0.0:1787432632.578366:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588435712 00010000:00010000:0.0:1787432632.578412:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563f9f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5071 expref: 9 pid: 8806 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.578458:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 98 00000100:00100000:0.0:1787432632.578468:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2400:x1874258588435712:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432632.578492:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787432632.578513:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787432632.578515:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787432632 00002000:00010000:0.0:1787432632.578517:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787432632 00002000:00010000:0.0:1787432632.578519:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787432632 00002000:00010000:0.0:1787432632.578521:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787432632.578526:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563f9f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5071 expref: 9 pid: 8806 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.578539:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563f9f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5071 expref: 9 pid: 8806 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.578561:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563f9f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5071 expref: 9 pid: 8806 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.578577:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432632.578582:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432632.578588:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e4b4591/0xca72b3b33563fa37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.578598:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e4b4591/0xca72b3b33563fa37 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.578640:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432632.578703:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2400:x1874258588435712:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 236us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432632.578710:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 98 00010000:00010000:3.0:1787432632.579245:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001e4b4591/0xca72b3b33563fa37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.579257:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e4b4591/0xca72b3b33563fa37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.579292:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e4b4591/0xca72b3b33563fa37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.579300:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e4b4591/0xca72b3b33563fa37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.579308:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e4b4591/0xca72b3b33563fa37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.579315:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432632.579319:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e4b4591/0xca72b3b33563fa37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.579329:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e4b4591/0xca72b3b33563fa37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.579343:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e4b4591/0xca72b3b33563fa37 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.579350:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e4b4591/0xca72b3b33563fa37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432632.579415:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2402:x1874258588435456:12345-192.168.204.24@tcp:1:lfs.0 Request processed in 19017us (21870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432632.579423:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 69 00000100:00100000:2.0:1787432632.591523:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432632.594791:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588435968 00000100:00100000:1.0:1787432632.594808:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588435968 00000100:00100000:1.0:1787432632.594950:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 56 00000100:00100000:1.0:1787432632.594961:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948411a1c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+48:12472:x1874258588435968:12345-192.168.204.24@tcp:35:lfs.0 00000004:00010000:1.0:1787432632.595025:0:6517:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563fa29 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5086 expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787432632.597436:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787432632.597487:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1787432632.597825:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:1.0:1787432632.597871:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fa3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.597891:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f9e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5063 expref: 52 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.597900:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fa3e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.597949:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f9e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5063 expref: 52 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.597983:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f9e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5063 expref: 52 pid: 6513 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432632.597999:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304463100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6517:1874258609458944:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432632.598251:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787432632.603794:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304463100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6517:1874258609458944:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432632.603829:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fa3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.610614:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432632.610907:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588436096 00000100:00100000:1.0:1787432632.610930:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588436096 00010000:00010000:1.0:1787432632.610970:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f9e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5063 expref: 53 pid: 6513 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432632.611014:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 99 00000100:00100000:1.0:1787432632.611035:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+53:2403:x1874258588436096:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432632.611050:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432632.611058:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f9e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5063 expref: 53 pid: 6513 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.611071:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f9e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5063 expref: 53 pid: 6513 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.611095:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0c00/0xca72b3b33563f9e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5063 expref: 53 pid: 6513 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.611128:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948435957f00) 00010000:00010000:1.0:1787432632.611133:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fa3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.611143:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fa3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.611150:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fa3e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.611222:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432632.611273:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+52:2403:x1874258588436096:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 250us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432632.611281:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 99 00010000:00010000:3.0:1787432632.611623:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fa3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.611631:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fa3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787432632.611751:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:3.0:1787432632.611862:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1787432632.611956:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304569f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1874258609459072:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787432632.612004:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432632.612049:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff948304743780 going to sleep for 11 seconds 00000100:00100000:1.0:1787432632.612299:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609459072 00000100:00100000:1.0:1787432632.612305:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609459072 00000100:00100000:1.0:1787432632.612337:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787432632.612346:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6517:x1874258609459072:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787432632.612441:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6517:x1874258609459072:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 95us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432632.612449:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787432632.612487:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304569f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1874258609459072:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787432632.612625:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:1.0:1787432632.612671:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304463100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1874258609459200:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787432632.612701:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432632.612715:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432632.613283:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609459200 00000100:00100000:3.0:1787432632.613290:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609459200 00000100:00100000:3.0:1787432632.613338:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787432632.613347:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6517:x1874258609459200:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787432632.613527:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6517:x1874258609459200:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 181us (824us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787432632.613534:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787432632.614041:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304463100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6517:1874258609459200:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787432632.614090:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1787432632.614127:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fa3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.614138:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fa3e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.614145:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fa3e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.614184:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432632.614190:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fa3e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.614198:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fa3e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.614213:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948435957f00) 00010000:00010000:1.0:1787432632.614216:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787432632.614221:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fa3e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.614227:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fa3e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787432632.614344:0:6517:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787432632.614408:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1787432632.616267:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 443708099761ns, next at 444708091620ns, rc = 0 00000001:00080000:1.0:1787432632.616289:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:1.0:1787432632.616410:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff948435957f00) 00010000:00010000:1.0:1787432632.616495:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787432632.616507:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1a00/0xca72b3b33563fa29 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5086 expref: 56 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432632.616797:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948411a1c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+55:12472:x1874258588435968:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 21836us (25283us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787432632.616808:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 56 00000020:00080000:1.0:1787432632.616813:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787432632.621089:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432632.621228:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588436224 00000100:00100000:1.0:1787432632.621238:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588436224 00000100:00100000:1.0:1787432632.621290:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 219 00000100:00100000:1.0:1787432632.621314:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+55:12472:x1874258588436224:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787432632.621337:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432632.621360:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563fa45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d508d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.621413:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563fa45 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d508d expref: 56 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.621439:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563fa45 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d508d expref: 56 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.621459:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:1.0:1787432632.621462:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787432632.621466:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850e00, rc 0) 00000100:00100000:1.0:1787432632.621523:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+56:12472:x1874258588436224:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 212us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432632.621530:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 219 00000100:00100000:0.0:1787432632.627402:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432632.627571:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588436480 00000100:00100000:2.0:1787432632.627580:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588436480 00000100:00100000:2.0:1787432632.627650:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 57 00000100:00100000:2.0:1787432632.627662:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+56:12472:x1874258588436480:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:2.0:1787432632.627885:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+57:12472:x1874258588436480:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 225us (492us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787432632.627893:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 57 00000100:00100000:3.0:1787432632.733240:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432632.733617:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588436608 00000100:00100000:2.0:1787432632.733628:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588436608 00000100:00100000:3.0:1787432632.733979:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 220 00000100:00100000:3.0:1787432632.733991:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+57:12482:x1874258588436608:12345-192.168.204.24@tcp:34:lfs.0 00010000:00010000:3.0:1787432632.734498:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563fa4c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734517:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563fa4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734530:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563fa4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734567:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fa53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734575:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fa53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734581:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fa53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734659:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563fa5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734667:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563fa5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734674:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563fa5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432632.734720:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563fa5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734798:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563fa4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734805:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563fa4c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734811:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563fa4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734817:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0a00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432632.734821:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563fa4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734837:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563fa4c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734851:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:3.0:1787432632.734854:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432632.734858:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563fa4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734864:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563fa4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734877:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fa53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734882:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fa53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734887:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fa53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734891:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432632.734894:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fa53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734898:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fa53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734904:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948411a6b000) 00010000:00010000:3.0:1787432632.734907:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432632.734909:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fa53 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734932:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fa53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734942:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563fa5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734946:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563fa5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734951:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563fa5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734955:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1800 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432632.734958:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563fa5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734963:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563fa5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734970:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:3.0:1787432632.734972:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432632.734975:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563fa5a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.734979:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563fa5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432632.735258:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+57:12482:x1874258588436608:12345-192.168.204.24@tcp:34:lfs.0 Request processed in 1265us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432632.735268:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 220 00000100:00100000:0.0:1787432632.772066:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432632.772980:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588436864 00000100:00100000:3.0:1787432632.772991:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588436864 00000100:00100000:3.0:1787432632.773050:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 221 00000100:00100000:3.0:1787432632.773061:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+57:12485:x1874258588436864:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432632.773083:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432632.773105:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563fa61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5094 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.773791:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563fa68 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.773808:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563fa68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.773818:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563fa68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.773830:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fa6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.773837:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fa6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.773843:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fa6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.773964:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563fa76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.773988:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563fa76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.773995:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563fa76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432632.774006:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787432632.774393:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563fa68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.774401:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563fa68 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.774407:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563fa68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.774413:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85f200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432632.774418:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563fa68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.774425:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563fa68 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.774437:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:2.0:1787432632.774447:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432632.774451:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563fa68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.774458:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563fa68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.774471:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fa6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.774487:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fa6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.774492:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fa6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.774497:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432632.774500:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fa6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.774505:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fa6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.774513:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948411a6b000) 00010000:00010000:2.0:1787432632.774516:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432632.774518:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fa6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.774524:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fa6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.774564:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1800/0xca72b3b33563fa61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5094 expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.774580:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563fa76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5094 expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.774586:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:2.0:1787432632.774588:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432632.774597:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e600, rc 0) 00000100:00100000:2.0:1787432632.774716:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+59:12485:x1874258588436864:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1656us (2662us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1787432632.774780:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 221 00000100:00100000:2.0:1787432632.779401:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432632.779424:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609459328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432632.779490:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432632.779492:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432632.779714:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609459584:0@lo:400:kworker.0 00000100:00100000:3.0:1787432632.779979:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609459840:0@lo:400:kworker.0 00000100:00100000:3.0:1787432632.780012:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432632.780298:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609460352:0@lo:400:kworker.0 00000100:00100000:3.0:1787432632.780328:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432632.780353:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787432632.780359:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609459712:0@lo:400:kworker.0 00000100:00100000:3.0:1787432632.780384:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432632.780401:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609460224:0@lo:400:kworker.0 00000100:00100000:3.0:1787432632.780419:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432632.780790:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609459840 00000100:00100000:3.0:1787432632.780798:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609459840 00000100:00100000:3.0:1787432632.780852:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787432632.780862:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609459840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432632.780937:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609459840:12345-0@lo:400:kworker.0 Request processed in 76us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432632.780943:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787432632.780986:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609459840:0@lo:400:kworker.0 00000100:00100000:3.0:1787432632.781025:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588436992 00000100:00100000:3.0:1787432632.781030:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588436992 00000100:00100000:3.0:1787432632.781057:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609460352 00000100:00100000:3.0:1787432632.781060:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609460352 00000100:00080000:3.0:1787432632.781081:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787432632.781096:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609459712 00000100:00100000:3.0:1787432632.781099:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609459712 00000100:00100000:3.0:1787432632.781110:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609460224 00000100:00100000:3.0:1787432632.781112:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609460224 00000100:00080000:3.0:1787432632.781124:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432632.781138:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1787432632.781145:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609460352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432632.781385:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609459328 00000100:00100000:0.0:1787432632.781390:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609459328 00000100:00100000:0.0:1787432632.781428:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787432632.781434:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609459328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787432632.781468:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787432632.781508:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609459328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (2017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432632.781514:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1787432632.781580:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432632.781594:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787432632.781600:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609459712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432632.781898:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609459712:12345-0@lo:400:kworker.0 Request processed in 298us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432632.781906:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787432632.781934:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787432632.781941:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609460224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432632.781968:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609460224:12345-0@lo:400:kworker.0 Request processed in 29us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432632.781974:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1787432632.781988:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 222 00000100:00100000:0.0:1787432632.781995:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+59:12485:x1874258588436992:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:0.0:1787432632.782055:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563fa84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.782083:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563fa84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.782094:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563fa84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.782131:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563fa84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.782138:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563fa84 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.782145:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563fa84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.782151:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432632.782155:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563fa84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.782200:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563fa84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.782211:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:0.0:1787432632.782214:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787432632.782217:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563fa84 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.782223:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489400/0xca72b3b33563fa84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.782282:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+59:12485:x1874258588436992:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 287us (2791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432632.782295:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 222 00000100:00100000:0.0:1787432632.782340:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609459712:0@lo:400:kworker.0 00000100:00100000:0.0:1787432632.782353:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609460224:0@lo:400:kworker.0 00000100:00100000:2.0:1787432632.782431:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609459328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432632.782647:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609459456:0@lo:400:kworker.0 00000100:00100000:2.0:1787432632.782695:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432632.782721:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609459968:0@lo:400:kworker.0 00000100:00100000:2.0:1787432632.783153:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432632.783212:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609460480:0@lo:400:kworker.0 00000100:00100000:2.0:1787432632.783241:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432632.783263:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432632.783269:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609460608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432632.783290:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432632.783340:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609459456 00000100:00100000:2.0:1787432632.783347:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609459456 00000100:00100000:2.0:1787432632.783417:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1787432632.783427:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609459456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432632.783485:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609459456:12345-0@lo:400:kworker.0 Request processed in 59us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432632.783491:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1787432632.783534:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609459456:0@lo:400:kworker.0 00000100:00100000:2.0:1787432632.783566:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609459968 00000100:00100000:2.0:1787432632.783570:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609459968 00000100:00100000:2.0:1787432632.783611:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1787432632.783618:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609459968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432632.783657:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609459968:12345-0@lo:400:kworker.0 Request processed in 40us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432632.783663:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1787432632.783685:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609459968:0@lo:400:kworker.0 00000100:00100000:2.0:1787432632.783929:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609460608 00000100:00100000:2.0:1787432632.783934:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609460608 00000100:00100000:2.0:1787432632.783963:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787432632.783970:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1874258609460608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432632.783986:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787432632.784024:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1874258609460608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432632.784029:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787432632.784060:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609460608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432632.784105:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609460480 00000100:00100000:2.0:1787432632.784108:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609460480 00000100:00100000:2.0:1787432632.784133:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787432632.784139:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1874258609460480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432632.784192:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1874258609460480:12345-0@lo:400:kworker.0 Request processed in 52us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432632.784198:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787432632.784220:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609460480:0@lo:400:kworker.0 00000100:00080000:2.0:1787432632.784273:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787432632.784278:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787432632.784823:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948304461180 x1874258609460352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432632.784837:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609460352:0@lo:400:kworker.0 00000100:00100000:3.0:1787432632.785905:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609460352:12345-0@lo:400:kworker.0 Request processed in 3396us (4212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432632.785933:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1787432632.789298:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432632.789415:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432632.789709:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609460096:0@lo:400:kworker.0 00000100:00100000:1.0:1787432632.789798:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432632.789839:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609459584 00000100:00100000:1.0:1787432632.789846:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609459584 00000100:00100000:1.0:1787432632.789888:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609460096 00000100:00100000:1.0:1787432632.789891:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609460096 00000100:00100000:1.0:1787432632.789934:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787432632.789943:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609459584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432632.789990:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609459584:12345-0@lo:400:kworker.0 Request processed in 48us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432632.789997:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787432632.790013:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787432632.790019:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609460096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432632.790041:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609460096:12345-0@lo:400:kworker.0 Request processed in 23us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432632.790046:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00080000:1.0:1787432632.790061:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432632.790085:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609459584:0@lo:400:kworker.0 00010000:00080000:1.0:1787432632.790096:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948304462d80 x1874258609460096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432632.790105:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609460096:0@lo:400:kworker.0 00000100:00100000:2.0:1787432632.790605:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588437248 00000100:00100000:2.0:1787432632.790611:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588437248 00000100:00100000:2.0:1787432632.790651:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 58 00000100:00100000:2.0:1787432632.790660:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+59:12485:x1874258588437248:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:2.0:1787432632.790981:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+60:12485:x1874258588437248:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 322us (1693us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787432632.790988:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 58 00000100:00100000:0.0:1787432632.917531:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432632.917639:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588437504 00000100:00100000:3.0:1787432632.917651:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588437504 00000100:00100000:3.0:1787432632.917733:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 223 00000100:00100000:3.0:1787432632.917747:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+60:12495:x1874258588437504:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787432632.917775:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432632.917778:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787432632.917808:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fa06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5078 expref: 60 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.917826:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:3.0:1787432632.917831:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432632.917847:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fa8b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d509b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.918001:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563fa92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.918017:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563fa92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.918042:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563fa92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432632.918054:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787432632.918210:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fa8b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d509b expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.918226:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563fa92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d509b expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.918234:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:3.0:1787432632.918236:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432632.918239:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f0a00, rc 0) 00000100:00100000:3.0:1787432632.918314:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+61:12495:x1874258588437504:12345-192.168.204.24@tcp:101:bash.0 Request processed in 570us (796us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1787432632.918321:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 223 00000100:00100000:3.0:1787432632.921976:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432632.922049:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432632.922133:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588437760 00000100:00100000:0.0:1787432632.922143:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588437760 00000100:00100000:0.0:1787432632.922245:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:0.0:1787432632.922256:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+61:2401:x1874258588437760:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432632.922273:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432632.922312:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0a00/0xca72b3b33563fa92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d509b expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.922333:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:0.0:1787432632.922338:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432632.922397:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+60:2401:x1874258588437760:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 142us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432632.922405:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:1.0:1787432632.923143:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588437632 00000100:00100000:1.0:1787432632.923159:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588437632 00000100:00100000:1.0:1787432632.923237:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 224 00000100:00100000:1.0:1787432632.923258:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+60:12495:x1874258588437632:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787432632.923278:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432632.923712:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563faa0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d50a2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.923747:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563faa7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.923760:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563faa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.923770:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563faa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.923884:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563faa0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50a2 expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.923903:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563faa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50a2 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.923920:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:1.0:1787432632.923923:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787432632.923927:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851600, rc 0) 00000100:00100000:1.0:1787432632.923982:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+61:12495:x1874258588437632:12345-192.168.204.24@tcp:101:bash.0 Request processed in 727us (2016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432632.923989:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 224 00000100:00100000:0.0:1787432632.927929:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432632.928009:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588438016 00000100:00100000:1.0:1787432632.928018:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588438016 00000100:00100000:1.0:1787432632.928091:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 225 00000100:00100000:1.0:1787432632.928116:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+61:12495:x1874258588438016:12345-192.168.204.24@tcp:36:bash.0 00010000:00010000:1.0:1787432632.928210:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432632.928239:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e600/0xca72b3b33563fa76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5094 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.928261:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:1.0:1787432632.928266:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432632.928828:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563faae lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.928846:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563faae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.928857:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563faae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787432632.928905:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:1.0:1787432632.928941:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e932f9be reply state 000000009f73a36a transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563faae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.928955:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563faae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.928962:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:1.0:1787432632.928964:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787432632.928968:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787432632.929197:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+63:12495:x1874258588438016:12345-192.168.204.24@tcp:36:bash.0 Request processed in 1081us (1287us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1787432632.929205:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 225 00000020:00080000:1.0:1787432632.929209:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787432632.933563:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432632.933705:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588438144 00000100:00100000:1.0:1787432632.933716:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588438144 00000100:00100000:1.0:1787432632.933808:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 226 00000100:00100000:1.0:1787432632.933819:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+63:12495:x1874258588438144:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787432632.933845:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432632.933866:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563fab5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d50a9 expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.933972:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fabc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.933988:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fabc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.933999:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fabc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432632.934393:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787432632.934398:0:10165:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432632.934419:0:10165:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fabc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.934444:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563fab5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50a9 expref: 65 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.934462:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fabc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50a9 expref: 64 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.934471:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:1.0:1787432632.934473:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432632.934492:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851400, rc 0) 00000100:00100000:1.0:1787432632.934583:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+64:12495:x1874258588438144:12345-192.168.204.24@tcp:101:bash.0 Request processed in 765us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432632.934591:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 226 00000100:00100000:0.0:1787432632.937785:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432632.937881:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588438400 00000100:00100000:1.0:1787432632.937894:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588438400 00000100:00100000:1.0:1787432632.937999:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 59 00000100:00100000:1.0:1787432632.938010:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+64:12495:x1874258588438400:12345-192.168.204.24@tcp:35:bash.0 00000100:00100000:1.0:1787432632.938458:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+65:12495:x1874258588438400:12345-192.168.204.24@tcp:35:bash.0 Request processed in 448us (685us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1787432632.938467:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 59 00000100:00100000:0.0:1787432633.007718:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432633.007809:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588438528 00000100:00100000:1.0:1787432633.007820:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588438528 00000100:00100000:1.0:1787432633.007918:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 227 00000100:00100000:1.0:1787432633.007930:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+65:12501:x1874258588438528:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787432633.007954:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432633.007973:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563fac3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d50b0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.008047:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563faca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.008061:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563faca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.008072:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563faca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432633.008112:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787432633.008128:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432633.008157:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563faca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.008220:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563fac3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50b0 expref: 67 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.008239:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563faca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50b0 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.008247:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:1.0:1787432633.008250:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432633.008254:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851000, rc 0) 00000100:00100000:1.0:1787432633.008306:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+66:12501:x1874258588438528:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 380us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432633.008313:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 227 00000100:00080000:2.0:1787432633.008379:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432633.014481:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432633.014892:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588438656 00000100:00100000:3.0:1787432633.014902:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588438656 00000100:00100000:3.0:1787432633.014979:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 228 00000100:00100000:3.0:1787432633.014990:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+66:12501:x1874258588438656:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432633.015026:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432633.015052:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fad1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d50b7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.015126:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fad8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.015140:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fad8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.015408:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fad8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.015425:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fadf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.015433:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fadf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.015441:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fadf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.015509:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563fae6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.015518:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563fae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.015525:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563fae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432633.015568:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787432633.015752:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787432633.015776:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563fae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.015789:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563fae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.015797:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fad8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.015804:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fad8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.015810:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fad8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.015816:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432633.015820:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fad8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.015827:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fad8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.015840:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:3.0:1787432633.015843:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432633.015847:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fad8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.015854:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fad8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.015868:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fadf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.016111:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fadf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.016117:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fadf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.016122:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432633.016126:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fadf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.016133:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fadf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.016142:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948411a6b000) 00010000:00010000:3.0:1787432633.016381:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432633.016386:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fadf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.016392:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fadf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.016430:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fad1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50b7 expref: 68 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.016444:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563fae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50b7 expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.016451:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:3.0:1787432633.016453:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432633.016462:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f1000, rc 0) 00000100:00100000:3.0:1787432633.016820:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+67:12501:x1874258588438656:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1830us (2346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432633.016829:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 228 00000100:00100000:0.0:1787432633.024136:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432633.026586:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432633.027890:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588438784 00000100:00100000:1.0:1787432633.027902:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588438784 00000100:00100000:1.0:1787432633.027975:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:1.0:1787432633.027986:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+67:2400:x1874258588438784:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432633.028001:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432633.028025:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1000/0xca72b3b33563fae6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50b7 expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.028046:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:1.0:1787432633.028052:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432633.028114:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+66:2400:x1874258588438784:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 130us (3989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432633.028139:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:2.0:1787432633.030412:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588439040 00000100:00100000:2.0:1787432633.030425:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588439040 00000100:00100000:2.0:1787432633.030479:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 229 00000100:00100000:2.0:1787432633.030489:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+66:12501:x1874258588439040:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432633.030508:0:10165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432633.030527:0:10165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563faed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d50be expref: -99 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.030648:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563faf4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.030663:0:10165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fabc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50a9 expref: 67 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.030693:0:10165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563faf4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.030728:0:10165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fabc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50a9 expref: 67 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.030741:0:10165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fabc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50a9 expref: 67 pid: 10165 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432633.030754:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609460736:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432633.030845:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff948412a70a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432633.035848:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432633.036618:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588439168 00000100:00100000:3.0:1787432633.036629:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588439168 00010000:00010000:3.0:1787432633.036672:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fabc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50a9 expref: 68 pid: 10165 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432633.036714:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 100 00000100:00100000:3.0:1787432633.036725:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94841223fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+68:2403:x1874258588439168:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432633.036740:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432633.036746:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fabc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50a9 expref: 68 pid: 10165 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.036761:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fabc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50a9 expref: 68 pid: 10165 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.036784:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:3.0:1787432633.036790:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563faf4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.036800:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563faf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.036807:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563faf4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.036825:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432633.036886:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94841223fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+68:2403:x1874258588439168:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 163us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432633.036894:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 100 00010000:00010000:2.0:1787432633.038940:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fabc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50a9 expref: 67 pid: 10165 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432633.038965:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609460736:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432633.038989:0:10165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563faf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.038999:0:10165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563faf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.039005:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563faf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432633.039093:0:10165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787432633.041462:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563faed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50be expref: 68 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.041508:0:10165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563faf4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50be expref: 67 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.041518:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:2.0:1787432633.041521:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787432633.041524:0:10165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85f200, rc 0) 00000100:00100000:2.0:1787432633.041869:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+67:12501:x1874258588439040:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 11379us (15299us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787432633.041878:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 229 00000100:00100000:2.0:1787432633.045871:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432633.045991:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588439424 00000100:00100000:3.0:1787432633.046000:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588439424 00000100:00100000:3.0:1787432633.046066:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00100000:3.0:1787432633.046078:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+67:12501:x1874258588439424:12345-192.168.204.24@tcp:103:lfs.0 00010000:00010000:3.0:1787432633.046094:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432633.046119:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563fa45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d508d expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.046137:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:3.0:1787432633.046154:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432633.046251:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+66:12501:x1874258588439424:12345-192.168.204.24@tcp:103:lfs.0 Request processed in 174us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432633.046259:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00100000:0.0:1787432633.049554:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432633.049883:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588439552 00000100:00100000:1.0:1787432633.049892:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588439552 00000100:00100000:1.0:1787432633.049965:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 230 00000100:00100000:1.0:1787432633.049976:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+66:12501:x1874258588439552:12345-192.168.204.24@tcp:58:lfs.0 00010000:00010000:1.0:1787432633.050083:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563fb02 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.050102:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563fb02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.050114:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563fb02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787432633.050248:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787432633.050339:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+66:12501:x1874258588439552:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 364us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432633.050347:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 230 00000100:00100000:2.0:1787432633.053507:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432633.053736:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588439680 00000100:00100000:3.0:1787432633.053746:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588439680 00000100:00100000:3.0:1787432633.053808:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 231 00000100:00100000:3.0:1787432633.053819:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+66:12501:x1874258588439680:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432633.053839:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432633.053861:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fb09 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d50c5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.053926:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563fb02 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.053937:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fb09 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50c5 expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.053970:0:6515:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563fb02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.053986:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fb09 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50c5 expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.054000:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:3.0:1787432633.054003:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787432633.054007:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fb09 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50c5 expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.054016:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f0200, rc 0) 00000100:00100000:3.0:1787432633.054423:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+67:12501:x1874258588439680:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 604us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432633.054432:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 231 00010000:00010000:1.0:1787432633.549287:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787432633.805660:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787432633.867501:0:13810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787432633.867518:0:13810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787432633.867546:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787432633.867555:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787432633.867717:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304462d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13810:1874258609460864:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787432633.867853:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432633.878961:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432633.879308:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588439808 00000100:00100000:3.0:1787432633.879317:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588439808 00000100:00100000:3.0:1787432633.879376:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 232 00000100:00100000:3.0:1787432633.879385:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+68:12502:x1874258588439808:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787432633.879414:0:10165:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787432633.879528:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+68:12502:x1874258588439808:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 143us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432633.879536:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 232 00000100:00100000:1.0:1787432633.881268:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304462d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13810:1874258609460864:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787432633.884841:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432633.884951:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588439936 00000100:00100000:2.0:1787432633.884961:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588439936 00000100:00100000:2.0:1787432633.885039:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 233 00000100:00100000:2.0:1787432633.885052:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+67:12502:x1874258588439936:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787432633.885139:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb10 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885159:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb10 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885228:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb10 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885245:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb17 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885267:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885275:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885302:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885311:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885319:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432633.885366:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787432633.885370:0:9020:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787432633.885383:0:9020:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885393:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb10 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885400:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb10 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885406:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb10 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885412:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fa00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432633.885416:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb10 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885430:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb10 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885443:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94841318b400) 00010000:00010000:2.0:1787432633.885446:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432633.885451:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb10 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885458:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb10 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885471:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885477:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb17 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885484:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb17 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885489:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432633.885492:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb17 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885499:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb17 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885506:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff948411a6bd00) 00010000:00010000:2.0:1787432633.885508:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432633.885511:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb17 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885525:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb17 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885541:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885547:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885553:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885558:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432633.885562:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885568:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885576:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:2.0:1787432633.885578:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432633.885581:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.885586:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432633.885664:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+67:12502:x1874258588439936:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 613us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432633.885671:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 233 00000100:00100000:2.0:1787432633.889441:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432633.889530:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588440192 00000100:00100000:3.0:1787432633.889554:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588440192 00000100:00100000:3.0:1787432633.889625:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 234 00000100:00100000:3.0:1787432633.889638:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+67:12502:x1874258588440192:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432633.889665:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432633.889690:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fb25 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d50cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.889814:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fb2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.889831:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fb2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.889843:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fb2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432633.889854:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787432633.889946:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fb2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.889954:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fb2c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.889961:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fb2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.889967:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432633.889971:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fb2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.889979:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fb2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.890002:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:3.0:1787432633.890005:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787432633.890010:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fb2c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.890016:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0600/0xca72b3b33563fb2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.890073:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fb25 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50cc expref: 69 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.890083:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94841318b400) 00010000:00010000:3.0:1787432633.890085:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432633.890089:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fb25 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50cc expref: 69 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.890097:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f0e00, rc 0) 00000100:00100000:3.0:1787432633.891855:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+68:12502:x1874258588440192:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2208us (2413us total) trans 4294967506 rc 301/301 00000100:00100000:3.0:1787432633.891868:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 234 00000100:00100000:0.0:1787432633.893778:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432633.893928:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588440320 00000100:00100000:1.0:1787432633.893952:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588440320 00000100:00100000:1.0:1787432633.894010:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 235 00000100:00100000:1.0:1787432633.894021:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+68:12502:x1874258588440320:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787432633.894059:0:6514:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787432633.894196:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+68:12502:x1874258588440320:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 177us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432633.894204:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 235 00000100:00100000:0.0:1787432633.896960:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432633.897045:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588440576 00000100:00100000:1.0:1787432633.897055:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588440576 00000100:00100000:1.0:1787432633.897115:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 236 00000100:00100000:1.0:1787432633.897127:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+68:12502:x1874258588440576:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432633.897148:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432633.897152:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787432633.897235:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563faca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50b0 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.897258:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:1.0:1787432633.897263:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432633.897278:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563fb3a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d50d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787432633.897642:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:1.0:1787432633.897783:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563fb41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.897797:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563fb41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.897826:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563fb41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.897880:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563fb3a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50d3 expref: 70 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.897908:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563fb41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50d3 expref: 69 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.897916:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9483032adb00) 00010000:00010000:1.0:1787432633.897919:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432633.897922:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850e00, rc 0) 00000100:00100000:1.0:1787432633.897991:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+69:12502:x1874258588440576:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 865us (1041us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1787432633.898000:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 236 00000100:00100000:0.0:1787432633.902068:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432633.902147:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588440832 00000100:00100000:3.0:1787432633.902159:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588440832 00000100:00100000:3.0:1787432633.902268:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 237 00000100:00100000:3.0:1787432633.902278:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+69:12502:x1874258588440832:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787432633.902340:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432633.902368:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850e00/0xca72b3b33563fb41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50d3 expref: 69 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.902404:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9483032adb00) 00010000:00010000:3.0:1787432633.902414:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432633.902433:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fb4f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.902446:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fb4f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.902455:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fb4f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.902468:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fb56 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x4a30aa70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.902474:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fb56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a30aa70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.902480:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fb56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a30aa70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.902520:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fb4f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.902527:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fb4f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.902534:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fb4f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.902540:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432633.902544:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fb4f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.902561:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fb4f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.902570:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:3.0:1787432633.902573:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432633.902576:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fb4f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.902582:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fb4f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.902965:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fb56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a30aa70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.902972:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fb56 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a30aa70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.902978:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fb56 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a30aa70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.902983:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432633.902986:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fb56 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a30aa70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.902992:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fb56 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4a30aa70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.903000:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x4a30aa70 (ffff948435957700) 00010000:00010000:3.0:1787432633.903002:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432633.903005:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fb56 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4a30aa70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.903022:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fb56 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4a30aa70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432633.905692:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+68:12502:x1874258588440832:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 2308us (2529us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787432633.905706:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 237 00000100:00100000:3.0:1787432633.910388:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432633.910487:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588440960 00000100:00100000:2.0:1787432633.910499:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588440960 00000100:00100000:2.0:1787432633.910567:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 238 00000100:00100000:2.0:1787432633.910579:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+68:12502:x1874258588440960:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787432633.910613:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432633.910638:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb5d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d50da expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.910674:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.910688:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.910702:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.910818:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50da expref: 70 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.910837:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50da expref: 69 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.910846:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948411a6bd00) 00010000:00010000:2.0:1787432633.910849:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787432633.910859:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e400, rc 0) 00000100:00100000:2.0:1787432633.910931:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+69:12502:x1874258588440960:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 354us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432633.910940:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 238 00000100:00100000:0.0:1787432633.921672:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432633.921771:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588441216 00000100:00100000:2.0:1787432633.921782:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588441216 00000100:00100000:2.0:1787432633.921849:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 239 00000100:00100000:2.0:1787432633.921860:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+69:12502:x1874258588441216:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787432633.921970:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb6b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.921989:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.922002:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787432633.922232:0:10165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1787432633.922245:0:10165:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 445014080116ns, next at 446014075803ns, rc = 0 00000004:00010000:2.0:1787432633.922296:0:10165:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f13e894 reply state 00000000419cf5d1 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.922309:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.922316:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948411a6bd00) 00010000:00010000:2.0:1787432633.922319:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787432633.922322:0:10165:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787432633.922425:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+71:12502:x1874258588441216:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 565us (763us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1787432633.922447:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 239 00000100:00100000:0.0:1787432633.925247:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432633.925511:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588441344 00000100:00100000:2.0:1787432633.925520:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588441344 00000100:00100000:2.0:1787432633.925581:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 240 00000100:00100000:2.0:1787432633.925602:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+71:12502:x1874258588441344:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787432633.925627:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432633.925647:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb72 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d50e1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.925707:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50e1 expref: 72 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.925721:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50e1 expref: 72 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.925741:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948411a6bd00) 00010000:00010000:2.0:1787432633.925744:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787432633.925748:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85fa00, rc 0) 00000100:00100000:2.0:1787432633.925806:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+72:12502:x1874258588441344:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 216us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432633.925814:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 240 00000100:00100000:3.0:1787432633.928274:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432633.928446:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588441472 00000100:00100000:1.0:1787432633.928456:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588441472 00000100:00100000:1.0:1787432633.928535:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 70 00000100:00100000:1.0:1787432633.928547:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2402:x1874258588441472:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787432633.928782:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+10:2402:x1874258588441472:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 237us (517us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787432633.928790:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 70 00000100:00080000:2.0:1787432633.929872:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432633.931627:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432633.931762:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588441728 00000100:00100000:2.0:1787432633.931772:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588441728 00000100:00100000:2.0:1787432633.931831:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 60 00000100:00100000:2.0:1787432633.931842:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+72:12502:x1874258588441728:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787432633.932106:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+73:12502:x1874258588441728:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 266us (487us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1787432633.932113:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 60 00000100:00100000:0.0:1787432633.934829:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432633.934935:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588441984 00000100:00100000:1.0:1787432633.934946:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588441984 00000100:00100000:1.0:1787432633.935008:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 241 00000100:00100000:1.0:1787432633.935019:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+73:12502:x1874258588441984:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787432633.935197:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+73:12502:x1874258588441984:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 144us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432633.935206:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 241 00000100:00100000:3.0:1787432633.937840:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432633.937987:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588442112 00000100:00100000:1.0:1787432633.937996:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588442112 00000100:00100000:1.0:1787432633.938067:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 242 00000100:00100000:1.0:1787432633.938078:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+73:12502:x1874258588442112:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432633.938099:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432633.938120:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563fb79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d50e8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.938234:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fb80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.938250:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fb80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.938261:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fb80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432633.938311:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787432633.938334:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fb80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.938365:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851e00/0xca72b3b33563fb79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50e8 expref: 75 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.938387:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fb80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50e8 expref: 74 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.938417:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948411a6bd00) 00010000:00010000:1.0:1787432633.938420:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787432633.938424:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851000, rc 0) 00000100:00100000:1.0:1787432633.938476:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+74:12502:x1874258588442112:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 400us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432633.938482:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 242 00000100:00100000:0.0:1787432633.941536:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432633.941698:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588442240 00000100:00100000:2.0:1787432633.941712:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588442240 00000100:00100000:2.0:1787432633.941778:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 71 00000100:00100000:2.0:1787432633.941790:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+10:2403:x1874258588442240:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787432633.941815:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432633.941837:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000749bfb2b/0xca72b3b33563fb87 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d50ef expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787432633.941864:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a0eb9, blocks: 0x0 00010000:00010000:2.0:1787432633.941897:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1787432633.941902:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432633.941912:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000749bfb2b/0xca72b3b33563fb87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50ef expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.941931:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000749bfb2b/0xca72b3b33563fb87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50ef expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.941946:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e600, rc 0) 00000100:00100000:2.0:1787432633.942008:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+11:2403:x1874258588442240:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 221us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432633.942016:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 71 00000100:00100000:0.0:1787432633.944304:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432633.944701:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588442496 00000100:00100000:3.0:1787432633.944710:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588442496 00000100:00100000:3.0:1787432633.944804:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 243 00000100:00100000:3.0:1787432633.944815:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+74:12502:x1874258588442496:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787432633.944933:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+74:12502:x1874258588442496:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 119us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432633.944941:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 243 00000100:00100000:0.0:1787432633.947255:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432633.947356:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588442624 00000100:00100000:1.0:1787432633.947366:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588442624 00000100:00100000:1.0:1787432633.947456:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 72 00000100:00100000:1.0:1787432633.947467:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+11:12502:x1874258588442624:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432633.947484:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432633.947503:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563fb8e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d50f6 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.947538:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000749bfb2b/0xca72b3b33563fb87 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50ef expref: 12 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.947548:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432633.947553:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432633.947559:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563fb8e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50f6 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.947607:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000749bfb2b/0xca72b3b33563fb87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50ef expref: 12 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.947640:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000749bfb2b/0xca72b3b33563fb87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50ef expref: 12 pid: 8430 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432633.947655:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304462d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1874258609460992:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432633.947789:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff948406cb59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432633.951053:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432633.951668:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588442752 00000100:00100000:3.0:1787432633.951679:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588442752 00010000:00010000:3.0:1787432633.951727:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000749bfb2b/0xca72b3b33563fb87 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50ef expref: 13 pid: 8430 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432633.951821:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 101 00000100:00100000:3.0:1787432633.951832:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+13:2403:x1874258588442752:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432633.951847:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432633.951870:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000749bfb2b/0xca72b3b33563fb87 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50ef expref: 13 pid: 8430 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.951884:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000749bfb2b/0xca72b3b33563fb87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50ef expref: 13 pid: 8430 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.951932:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432633.951938:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432633.951947:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563fb8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50f6 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.951958:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563fb8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50f6 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.952002:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563fb8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50f6 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432633.952017:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304569f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6498:1874258609461120:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787432633.952112:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff948304743180 going to sleep for 11 seconds 00010000:00010000:1.0:1787432633.953932:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000749bfb2b/0xca72b3b33563fb87 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50ef expref: 13 pid: 8430 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432633.953957:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304462d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1874258609460992:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432633.953990:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563fb8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50f6 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.954006:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851e00, rc 0) 00000100:00100000:1.0:1787432633.954298:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+12:12502:x1874258588442624:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 6829us (7049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432633.954309:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 72 00000100:00100000:3.0:1787432633.954677:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304569f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6498:1874258609461120:192.168.204.24@tcp:105: 00010000:00010000:3.0:1787432633.954695:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432633.954723:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+11:2403:x1874258588442752:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 2894us (3684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432633.954733:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 101 00000100:00100000:0.0:1787432633.961798:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432633.962054:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588442880 00000100:00100000:3.0:1787432633.962067:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588442880 00002000:00100000:3.0:1787432633.962141:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff948303adaa00 x1874258588442880/t0(0) o4->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:344/0 lens 504/0 e 0 to 0 dl 1787432644 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787432633.962153:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948303adaa00 with x1874258588442880 ext(0->12) 00002000:00010000:3.0:1787432633.962159:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948303adaa00 00000100:00100000:3.0:1787432633.962320:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 6 00000100:00100000:3.0:1787432633.962331:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+11:2403:x1874258588442880:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787432633.963565:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+13:2403:x1874258588442880:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 1227us (1769us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787432633.963577:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 6 00002000:00100000:3.0:1787432633.963595:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff948303adaa00 x1874258588442880/t4294967321(0) o4->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:344/0 lens 504/448 e 0 to 0 dl 1787432644 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787432633.963605:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948303adaa00 with x1874258588442880 ext(0->12) 00002000:00010000:3.0:1787432633.963611:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948303adaa00 00000100:00100000:2.0:1787432633.966451:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432633.966565:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588443008 00000100:00100000:3.0:1787432633.966575:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588443008 00000100:00100000:3.0:1787432633.966747:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 244 00000100:00100000:3.0:1787432633.966761:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+74:12502:x1874258588443008:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787432633.968911:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:0.0:1787432633.968927:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1787432633.968965:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787432633.968981:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9483024d9240 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787432633.968985:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94843352e800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9483024d9900 00000020:00080000:0.0:1787432633.968989:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94843352e300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff948420439200 00000004:00080000:0.0:1787432633.969015:0:6492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1787432633.969044:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94840932ff00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787432633.969048:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94843352fa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94840932f3c0 00000020:00080000:0.0:1787432633.969051:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94843352f600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94843f97c600 00000100:00100000:0.0:1787432633.969312:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:12502:x1874258588443008:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 2549us (2868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432633.969336:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 244 00010000:00010000:3.0:1787432633.969419:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f893 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969431:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f893 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969440:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f893 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969446:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432633.969451:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f893 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969458:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f893 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969482:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff948411a7a400) 00010000:00010000:3.0:1787432633.969485:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432633.969490:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f893 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969496:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1c00/0xca72b3b33563f893 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969521:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f93b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969528:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f93b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969534:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f93b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969539:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488c00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432633.969542:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f93b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969547:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f93b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969554:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff948435957b00) 00010000:00010000:3.0:1787432633.969557:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432633.969560:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f93b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969565:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488c00/0xca72b3b33563f93b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969604:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f9b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969611:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f9b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969616:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f9b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969622:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ea00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432633.969625:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f9b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969631:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f9b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969639:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948411a6b000) 00010000:00010000:3.0:1787432633.969642:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432633.969644:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f9b9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969650:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b33563f9b9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969661:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f9dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969668:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f9dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969673:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f9dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969687:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432633.969690:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f9dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969695:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f9dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969703:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948411a6b000) 00010000:00010000:3.0:1787432633.969705:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432633.969708:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f9dc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969714:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563f9dc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969731:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563faae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969737:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563faae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969743:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563faae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969748:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851a00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432633.969750:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563faae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969757:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563faae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969774:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:3.0:1787432633.969777:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432633.969780:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563faae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969785:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563faae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969797:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969804:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb6b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969810:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969815:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432633.969818:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969824:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb6b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969830:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948411a6bd00) 00010000:00010000:3.0:1787432633.969833:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787432633.969836:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb6b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.969841:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b33563fb6b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787432633.970005:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1787432633.970069:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787432633.970091:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609461376:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787432633.970186:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432633.970225:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432633.970232:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609461248:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787432633.970257:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432633.970285:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609461376 00000100:00100000:2.0:1787432633.970292:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609461376 00000100:00100000:2.0:1787432633.970328:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609461248 00000100:00100000:2.0:1787432633.970332:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609461248 00000100:00100000:2.0:1787432633.970355:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787432633.970365:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1874258609461376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787432633.970394:0:8806:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:2.0:1787432633.970421:0:8806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b55a793/0xca72b3b33563fb95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.970441:0:8806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f949 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d504e expref: 12 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.970451:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1787432633.970455:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432633.970460:0:8806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b55a793/0xca72b3b33563fb95 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.970489:0:8806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f949 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d504e expref: 12 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.970517:0:8806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f949 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d504e expref: 12 pid: 8806 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432633.970530:0:8806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8806:1874258609461632:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432633.970575:0:8806:0:(client.c:2715:ptlrpc_set_wait()) set ffff948412a70cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432633.970592:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787432633.970600:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1874258609461248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787432633.970613:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:2.0:1787432633.970637:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8a0eb8, atime: 0x6a8a0eb8, ctime: 0x6a8a0eb8, blocks: 0x8 00010000:00010000:2.0:1787432633.970642:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563fb9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.970650:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1787432633.970653:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432633.970658:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563fb9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.970673:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563fb9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.970682:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563fb9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.970689:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563fb9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.970712:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787432633.970829:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3642:x1874258609461248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 228us (570us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787432633.970836:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:2.0:1787432633.970859:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432633.970865:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563fb9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.970874:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e600 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432633.970878:0:9519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563fb9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.970886:0:9519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563fb9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.970913:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563fb9c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.970919:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000749bfb2b/0xca72b3b33563fb9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.970936:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432633.970939:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432633.970940:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787432633.970971:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff948303adb480/2, rc 0, transno 4294967311 00000100:00100000:2.0:1787432633.970977:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609461248:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787432633.971313:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609461504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787432633.971346:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432633.971429:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609461504 00000100:00100000:2.0:1787432633.971434:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609461504 00000100:00100000:2.0:1787432633.971468:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787432633.971476:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3643:x1874258609461504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787432633.971556:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787432633.971560:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787432633 00002000:00010000:2.0:1787432633.971563:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787432633.971565:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787432633 -> 1787432633 00002000:00010000:2.0:1787432633.971567:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787432633.971611:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3643:x1874258609461504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 135us (263us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787432633.971618:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:3.0:1787432633.973954:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff948435b65880/2, rc 0, transno 4294967322 00000100:00100000:3.0:1787432633.973973:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609461504:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787432633.977326:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432633.977414:0:8806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8806:1874258609461632:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432633.977448:0:8806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b55a793/0xca72b3b33563fb95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432633.977499:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432633.977529:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588443264 00000100:00100000:2.0:1787432633.977537:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588443264 00010000:00010000:2.0:1787432633.977578:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f949 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d504e expref: 13 pid: 8806 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432633.977622:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 102 00000100:00100000:2.0:1787432633.977634:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+13:2402:x1874258588443264:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432633.977650:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432633.977672:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f949 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d504e expref: 13 pid: 8806 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.977686:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f949 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d504e expref: 13 pid: 8806 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.977712:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa884983/0xca72b3b33563f949 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d504e expref: 13 pid: 8806 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.977729:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432633.977734:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432633.977739:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b55a793/0xca72b3b33563fb95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.977749:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b55a793/0xca72b3b33563fb95 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.977776:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432633.977826:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+12:2402:x1874258588443264:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 194us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432633.977835:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 102 00010000:00010000:2.0:1787432633.977860:0:8806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b55a793/0xca72b3b33563fb95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.977869:0:8806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b55a793/0xca72b3b33563fb95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.977899:0:8806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b55a793/0xca72b3b33563fb95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.977907:0:8806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b55a793/0xca72b3b33563fb95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.977925:0:8806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787432633.978094:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3642:x1874258609461376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7729us (7931us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787432633.978102:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787432633.978114:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588443136 00000100:00100000:2.0:1787432633.978118:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588443136 00000100:00100000:2.0:1787432633.978143:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 76 00000100:00100000:2.0:1787432633.978149:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+12:2403:x1874258588443136:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1787432633.978241:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432633.978248:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b55a793/0xca72b3b33563fb95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.978257:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ee00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432633.978263:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b55a793/0xca72b3b33563fb95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.978271:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b55a793/0xca72b3b33563fb95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.978294:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b55a793/0xca72b3b33563fb95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.978301:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b55a793/0xca72b3b33563fb95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.978320:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432633.978322:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432633.978323:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787432633.978529:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff948435b65f80/2, rc 0, transno 4294967323 00000100:00100000:2.0:1787432633.978536:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609461376:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1787432633.982424:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1787432633.982443:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:2.0:1787432633.983015:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2403:x1874258588443136:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 4858us (5694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432633.983035:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 76 00000100:00100000:2.0:1787432633.986626:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432633.986729:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588443520 00000100:00100000:0.0:1787432633.986740:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588443520 00000100:00100000:0.0:1787432633.986803:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 245 00000100:00100000:0.0:1787432633.986814:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:12502:x1874258588443520:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787432633.986868:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432633.986903:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851000/0xca72b3b33563fb80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50e8 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432633.986922:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948411a6bd00) 00010000:00010000:0.0:1787432633.986927:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432633.986961:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fba3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432633.986976:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fba3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432633.986986:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fba3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787432633.987126:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000645bf330 reply state 000000002e8338d1 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fba3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432633.987139:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fba3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432633.987146:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948411a6bd00) 00010000:00010000:0.0:1787432633.987362:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787432633.987365:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787432633.987463:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:12502:x1874258588443520:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 650us (845us total) trans 4294967510 rc 0/0 00000100:00100000:0.0:1787432633.987471:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 245 00000100:00100000:1.0:1787432633.990263:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432633.990339:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588443648 00000100:00100000:3.0:1787432633.990349:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588443648 00000100:00100000:3.0:1787432633.990403:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 77 00000100:00100000:3.0:1787432633.990414:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2402:x1874258588443648:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787432633.990558:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787432633.990562:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1787432633 -> 1787432632 00002000:00010000:3.0:1787432633.990565:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787432632 00002000:00010000:3.0:1787432633.990567:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787432633 -> 1787432632 00002000:00010000:3.0:1787432633.990570:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787432633.990643:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2402:x1874258588443648:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 231us (393us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787432633.990652:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 77 00000100:00100000:2.0:1787432633.993065:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432633.993205:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588443904 00000100:00100000:3.0:1787432633.993213:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588443904 00000100:00100000:3.0:1787432633.993265:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 246 00000100:00100000:3.0:1787432633.993275:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:12502:x1874258588443904:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787432633.993343:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563fbaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.993360:0:9020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb64 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50da expref: 22 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.993387:0:9020:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563fbaa lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.993427:0:9020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50da expref: 22 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432633.993440:0:9020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50da expref: 22 pid: 9020 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432633.993453:0:9020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9020:1874258609461760:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432633.993533:0:9020:0:(client.c:2715:ptlrpc_set_wait()) set ffff948304743180 going to sleep for 11 seconds 00000100:00100000:3.0:1787432633.996833:0:9020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9020:1874258609461760:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432633.996866:0:9020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563fbaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432633.997005:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432633.997203:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588444032 00000100:00100000:1.0:1787432633.997210:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588444032 00010000:00010000:1.0:1787432633.997246:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50da expref: 23 pid: 9020 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432633.997279:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 103 00000100:00100000:1.0:1787432633.997288:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+23:2403:x1874258588444032:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432633.997316:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432633.997323:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50da expref: 23 pid: 9020 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.997336:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50da expref: 23 pid: 9020 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.997358:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33563fb64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50da expref: 23 pid: 9020 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.997375:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948411a6bd00) 00010000:00010000:1.0:1787432633.997379:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563fbaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.997389:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563fbaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.997398:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563fbaa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432633.997421:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432633.997469:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:2403:x1874258588444032:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 181us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432633.997476:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 103 00010000:00010000:2.0:1787432633.998336:0:9020:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563fbaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.998348:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563fbaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.998390:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563fbaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.998398:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563fbaa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.998416:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563fbaa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.998421:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432633.998425:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563fbaa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.998432:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563fbaa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.998444:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948411a6bd00) 00010000:00010000:2.0:1787432633.998446:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787432633.998450:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563fbaa lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432633.998456:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0000/0xca72b3b33563fbaa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432633.998527:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:12502:x1874258588443904:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 5251us (5470us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787432633.998536:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 246 00000100:00100000:2.0:1787432634.001712:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432634.001819:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588444160 00000100:00100000:3.0:1787432634.001829:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588444160 00000100:00100000:3.0:1787432634.001922:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 78 00000100:00100000:3.0:1787432634.001934:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2402:x1874258588444160:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787432634.001983:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c7cf0e4c/0xca72b3b33563fbb1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.002003:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563fb8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50f6 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.002012:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432634.002279:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787432634.002285:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7cf0e4c/0xca72b3b33563fbb1 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.002324:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563fb8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50f6 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.002338:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563fb8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50f6 expref: 8 pid: 8432 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432634.002353:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874258609461888:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432634.002475:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff948304743180 going to sleep for 11 seconds 00000100:00100000:0.0:1787432634.005849:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432634.005929:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588444288 00000100:00100000:3.0:1787432634.005938:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588444288 00010000:00010000:3.0:1787432634.005978:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563fb8e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50f6 expref: 9 pid: 8432 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432634.006032:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 104 00000100:00100000:3.0:1787432634.006042:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2402:x1874258588444288:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432634.006057:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432634.006078:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563fb8e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50f6 expref: 9 pid: 8432 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.006093:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563fb8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50f6 expref: 9 pid: 8432 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.006119:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787432634.006472:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787432634.006478:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7cf0e4c/0xca72b3b33563fbb1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.006489:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7cf0e4c/0xca72b3b33563fbb1 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.006510:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432634.006562:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+9:2402:x1874258588444288:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 520us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432634.006570:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 104 00010000:00010000:2.0:1787432634.007776:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fd65974/0xca72b3b33563fb8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50f6 expref: 8 pid: 8432 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432634.007800:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1874258609461888:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432634.007826:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c7cf0e4c/0xca72b3b33563fbb1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.007857:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c7cf0e4c/0xca72b3b33563fbb1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.007865:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7cf0e4c/0xca72b3b33563fbb1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.007901:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c7cf0e4c/0xca72b3b33563fbb1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.007909:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7cf0e4c/0xca72b3b33563fbb1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.007918:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7cf0e4c/0xca72b3b33563fbb1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.007925:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1c00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432634.007929:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7cf0e4c/0xca72b3b33563fbb1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.007938:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7cf0e4c/0xca72b3b33563fbb1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.007957:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7cf0e4c/0xca72b3b33563fbb1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.007975:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7cf0e4c/0xca72b3b33563fbb1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432634.008158:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2402:x1874258588444160:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 6226us (6457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.008197:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 78 00000100:00100000:0.0:1787432634.010692:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432634.010785:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588444544 00000100:00100000:3.0:1787432634.010794:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588444544 00000100:00100000:3.0:1787432634.010886:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 247 00000100:00100000:3.0:1787432634.010905:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:12502:x1874258588444544:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787432634.010983:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fbb8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.011000:0:10165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563faa7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50a2 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.011011:0:10165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fbb8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.011057:0:10165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563faa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50a2 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.011072:0:10165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563faa7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50a2 expref: 21 pid: 6513 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432634.011098:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304568e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609462016:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432634.011213:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff948304743900 going to sleep for 11 seconds 00000100:00100000:3.0:1787432634.013709:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304568e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609462016:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432634.013739:0:10165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fbb8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432634.015026:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432634.015097:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588444672 00000100:00100000:2.0:1787432634.015106:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588444672 00010000:00010000:2.0:1787432634.015160:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563faa7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50a2 expref: 22 pid: 6513 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432634.015227:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 105 00000100:00100000:2.0:1787432634.015237:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:2403:x1874258588444672:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432634.015252:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432634.015259:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563faa7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50a2 expref: 22 pid: 6513 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.015272:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563faa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50a2 expref: 22 pid: 6513 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.015293:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851600/0xca72b3b33563faa7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50a2 expref: 22 pid: 6513 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.015310:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:2.0:1787432634.015316:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fb09 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50c5 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.015339:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fbb8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.015347:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fbb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.015354:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fbb8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.015373:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432634.015416:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:2403:x1874258588444672:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 181us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.015423:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 105 00010000:00010000:0.0:1787432634.015559:0:10165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fbb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.015567:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fbb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.015737:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563fbbf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.015749:0:10165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb72 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50e1 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.015757:0:10165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563fbbf lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.015784:0:10165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50e1 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.015796:0:10165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb72 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50e1 expref: 21 pid: 6515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432634.015808:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609462144:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787432634.015864:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840932fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432634.019397:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432634.019495:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588444800 00000100:00100000:1.0:1787432634.019506:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588444800 00010000:00010000:1.0:1787432634.019553:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb72 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50e1 expref: 22 pid: 6515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432634.019633:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 106 00000100:00100000:1.0:1787432634.019644:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842eb4b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:2402:x1874258588444800:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432634.019659:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432634.019667:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb72 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50e1 expref: 22 pid: 6515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.019682:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb72 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50e1 expref: 22 pid: 6515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.019709:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948411a6bd00) 00010000:00010000:1.0:1787432634.019714:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563fbbf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.019725:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563fbbf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.019733:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563fbbf lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.019753:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432634.019819:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842eb4b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:2402:x1874258588444800:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 176us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432634.019827:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 106 00010000:00010000:3.0:1787432634.020731:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fa00/0xca72b3b33563fb72 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50e1 expref: 21 pid: 6515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432634.020751:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609462144:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432634.020771:0:10165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563fbbf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.020780:0:10165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563fbbf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.020785:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563fbbf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787432634.020908:0:10165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1787432634.021026:0:10165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:3.0:1787432634.021061:0:10165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1787432634.022339:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304568e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10165:1874258609462272:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787432634.022419:0:10165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432634.022463:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff948304743480 going to sleep for 11 seconds 00000100:00100000:0.0:1787432634.022540:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609462272 00000100:00100000:0.0:1787432634.022548:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609462272 00000100:00100000:0.0:1787432634.022634:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787432634.022646:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10165:x1874258609462272:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787432634.022738:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10165:x1874258609462272:12345-0@lo:1000:mdt00_004.0 Request processed in 94us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432634.022745:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787432634.022881:0:10165:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1787432634.022895:0:10165:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:3.0:1787432634.022927:0:10165:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff948435b65880, transno 4294967322 00000004:00080000:3.0:1787432634.022945:0:10165:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff948435b65f80, transno 4294967323 00000100:00100000:3.0:1787432634.022953:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304568e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10165:1874258609462272:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1787432634.023122:0:10165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:3.0:1787432634.023218:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304568e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10165:1874258609462400:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787432634.023250:0:10165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432634.023268:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff948304743f00 going to sleep for 11 seconds 00000100:00080000:1.0:1787432634.023327:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432634.023698:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609462400 00000100:00100000:2.0:1787432634.023704:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609462400 00000100:00100000:2.0:1787432634.023781:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787432634.023790:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948433738450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10165:x1874258609462400:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787432634.023923:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948433738450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10165:x1874258609462400:12345-0@lo:1000:mdt00_004.0 Request processed in 134us (671us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787432634.023931:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787432634.024333:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304568e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10165:1874258609462400:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1787432634.024370:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563fbbf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.024380:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563fbbf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.024389:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563fbbf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.024395:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488a00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432634.024400:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563fbbf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.024407:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563fbbf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.024422:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948411a6bd00) 00010000:00010000:3.0:1787432634.024425:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787432634.024429:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563fbbf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.024436:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488a00/0xca72b3b33563fbbf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.024469:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563fb02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.024476:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563fb02 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.024482:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563fb02 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.024488:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432634.024491:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563fb02 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.024496:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563fb02 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.024505:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:3.0:1787432634.024507:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787432634.024513:0:10165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fb09 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50c5 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.024525:0:10165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fb09 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50c5 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.024534:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fb09 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50c5 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.024565:0:10165:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fb09 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50c5 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432634.024699:0:10165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304569180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609462528:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787432634.024767:0:10165:0:(client.c:2715:ptlrpc_set_wait()) set ffff948304743f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432634.027785:0:10165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304569180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10165:1874258609462528:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787432634.027820:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563fb02 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.027839:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850000/0xca72b3b33563fb02 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.027869:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563fbc6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.027883:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563fbc6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.027904:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563fbc6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.027915:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563fbc6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.027921:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563fbc6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.027928:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563fbc6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.027934:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851a00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432634.027938:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563fbc6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.027947:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563fbc6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.027959:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:1.0:1787432634.027963:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432634.027967:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563fbc6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.027979:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851a00/0xca72b3b33563fbc6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.027990:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fbb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.027996:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fbb8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.028001:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fbb8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.028006:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432634.028009:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fbb8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.028015:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fbb8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.028024:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:1.0:1787432634.028026:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787432634.028029:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fbb8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.028034:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1600/0xca72b3b33563fbb8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432634.028238:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+24:12502:x1874258588444544:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 17333us (17554us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1787432634.028250:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 247 00000020:00080000:1.0:1787432634.028262:0:10165:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787432634.033468:0:13810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787432634.033478:0:13810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787432634.034013:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787432634.034035:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787432634.034291:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432634.034391:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432634.034421:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588445056 00000100:00100000:1.0:1787432634.034430:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588445056 00000100:00100000:1.0:1787432634.034468:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588445184 00000100:00100000:1.0:1787432634.034471:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588445184 00000100:00100000:1.0:1787432634.034488:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 61 00000100:00100000:1.0:1787432634.034498:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+25:12502:x1874258588445056:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787432634.034808:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787432634.034842:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:1.0:1787432634.034876:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fbcd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.034906:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fbcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.034919:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fbcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.034928:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fbcd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.034935:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fbcd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.034942:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fbcd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.034961:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787432634.035055:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:12502:x1874258588445056:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 557us (769us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787432634.035078:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 61 00000020:00080000:1.0:1787432634.035083:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787432634.035099:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 62 00000100:00100000:1.0:1787432634.035107:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948411a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+26:12501:x1874258588445184:12345-192.168.204.24@tcp:49:lfs.0 00000100:00100000:1.0:1787432634.035402:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948411a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+26:12501:x1874258588445184:12345-192.168.204.24@tcp:49:lfs.0 Request processed in 295us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432634.035409:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 62 00010000:00010000:1.0:1787432634.035456:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432634.035462:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fbcd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.035470:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432634.035474:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fbcd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.035483:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fbcd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.035498:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948411a6bd00) 00010000:00010000:1.0:1787432634.035501:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787432634.035506:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fbcd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.035512:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303851400/0xca72b3b33563fbcd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.035526:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432634.035528:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432634.035530:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432634.038536:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432634.038648:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588445440 00000100:00100000:2.0:1787432634.038658:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588445440 00000100:00100000:2.0:1787432634.038728:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 248 00000100:00100000:2.0:1787432634.038740:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+26:12501:x1874258588445440:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:2.0:1787432634.038956:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787432634.039052:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+26:12501:x1874258588445440:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 314us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.039079:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 248 00000100:00100000:3.0:1787432634.074069:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432634.074241:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588445568 00000100:00100000:2.0:1787432634.074252:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588445568 00000100:00100000:2.0:1787432634.074314:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 249 00000100:00100000:2.0:1787432634.074325:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+26:12504:x1874258588445568:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432634.074344:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432634.074365:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33563fbd4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d50fd expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.074433:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563fbdb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.074449:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563fbdb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.074460:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563fbdb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.074476:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563fbe2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.074483:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563fbe2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.074490:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563fbe2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.074579:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e5200/0xca72b3b33563fbe9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.074618:0:9020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563faf4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50be expref: 27 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.074634:0:9020:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e5200/0xca72b3b33563fbe9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.074670:0:9020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563faf4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50be expref: 27 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.074685:0:9020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563faf4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50be expref: 27 pid: 10165 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432634.074699:0:9020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9020:1874258609462656:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432634.074799:0:9020:0:(client.c:2715:ptlrpc_set_wait()) set ffff948412a70a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787432634.079361:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432634.079467:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588445824 00000100:00100000:1.0:1787432634.079476:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588445824 00000100:00100000:1.0:1787432634.079540:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 63 00000100:00100000:1.0:1787432634.079550:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+28:6171:x1874258588445824:12345-192.168.204.24@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787432634.079819:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+29:6171:x1874258588445824:12345-192.168.204.24@tcp:35:ldlm_bl.0 Request processed in 269us (468us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1787432634.079826:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 63 00000100:00100000:2.0:1787432634.080789:0:9020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9020:1874258609462656:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432634.080821:0:9020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e5200/0xca72b3b33563fbe9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432634.083367:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432634.083815:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588445952 00000100:00100000:2.0:1787432634.083826:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588445952 00010000:00010000:2.0:1787432634.083866:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563faf4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50be expref: 29 pid: 10165 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432634.083917:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 107 00000100:00100000:2.0:1787432634.083928:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+29:2402:x1874258588445952:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432634.083943:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432634.083966:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563faf4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50be expref: 29 pid: 10165 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.083979:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563faf4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50be expref: 29 pid: 10165 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.084003:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f200/0xca72b3b33563faf4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50be expref: 29 pid: 10165 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.084030:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:2.0:1787432634.084036:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e5200/0xca72b3b33563fbe9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.084047:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e5200/0xca72b3b33563fbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.084054:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e5200/0xca72b3b33563fbe9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.084094:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432634.084206:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+28:2402:x1874258588445952:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 279us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.084214:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 107 00010000:00010000:0.0:1787432634.084282:0:9020:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e5200/0xca72b3b33563fbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084290:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e5200/0xca72b3b33563fbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432634.084346:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787432634.084351:0:9020:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787432634.084371:0:9020:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e5200/0xca72b3b33563fbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084383:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e5200/0xca72b3b33563fbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084393:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563fbdb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084400:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563fbdb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084407:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563fbdb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084420:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fce00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432634.084424:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563fbdb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084432:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563fbdb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084442:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:0.0:1787432634.084444:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432634.084448:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563fbdb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084453:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b33563fbdb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084464:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563fbe2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084470:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563fbe2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084475:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563fbe2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084480:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fdc00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432634.084482:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563fbe2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084488:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563fbe2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084508:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff948411a6bf00) 00010000:00010000:0.0:1787432634.084510:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432634.084513:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563fbe2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084519:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b33563fbe2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084559:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33563fbd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50fd expref: 28 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084574:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e5200/0xca72b3b33563fbe9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50fd expref: 27 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.084580:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:0.0:1787432634.084595:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432634.084599:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e5200, rc 0) 00000100:00100000:0.0:1787432634.084644:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:12504:x1874258588445568:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 10321us (10586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432634.084651:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 249 00000100:00100000:1.0:1787432634.315474:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609462784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432634.315551:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432634.315707:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609462784 00000100:00100000:3.0:1787432634.315717:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609462784 00000100:00100000:3.0:1787432634.315769:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787432634.315781:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609462784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787432634.315813:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787432634.315868:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609462784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432634.315875:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787432634.318943:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609462784:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787432634.572315:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787432634.883136:0:14720:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787432634.883146:0:14720:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787432634.883197:0:14720:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787432634.883205:0:14720:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787432634.914889:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432634.914932:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432634.914971:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432634.915075:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432634.915109:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432634.915144:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588446336 00000100:00100000:2.0:1787432634.915154:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588446336 00000100:00100000:2.0:1787432634.915239:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 103 00000100:00100000:2.0:1787432634.915251:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2401:x1874258588446336:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432634.915330:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2401:x1874258588446336:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 81us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.915339:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 103 00000100:00100000:2.0:1787432634.915362:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588446592 00000100:00100000:2.0:1787432634.915366:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588446592 00000100:00100000:2.0:1787432634.915400:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588446208 00000100:00100000:2.0:1787432634.915404:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588446208 00000100:00100000:2.0:1787432634.915979:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588446464 00000100:00100000:2.0:1787432634.916058:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588446464 00000100:00100000:2.0:1787432634.916089:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 366 00000100:00100000:2.0:1787432634.916097:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588446592:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432634.916136:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588446592:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 39us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.916143:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 366 00000100:00100000:2.0:1787432634.916158:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 367 00000100:00100000:2.0:1787432634.916189:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588446208:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432634.916214:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588446208:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 51us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.916220:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 367 00000100:00100000:2.0:1787432634.916241:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 368 00000100:00100000:2.0:1787432634.916248:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588446464:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432634.916274:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588446464:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.916281:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 368 00000100:00080000:2.0:1787432634.916303:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787432634.916308:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787432634.916311:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432634.916733:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588446080 00000100:00100000:3.0:1787432634.916740:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588446080 00000100:00100000:3.0:1787432634.916797:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 399 00000100:00100000:3.0:1787432634.916806:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:2401:x1874258588446080:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432634.916859:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:2401:x1874258588446080:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 53us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432634.916866:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 399 00000040:00080000:3.0:1787432635.083390:0:13810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787432635.083401:0:13810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787432635.083448:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787432635.083456:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787432635.083617:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13810:1874258609462912:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787432635.083727:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff948304743840 going to sleep for 11 seconds 00000100:00100000:1.0:1787432635.089413:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432635.089580:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588446720 00000100:00100000:2.0:1787432635.089589:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588446720 00000100:00100000:2.0:1787432635.089679:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 250 00000100:00100000:2.0:1787432635.089690:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+28:12516:x1874258588446720:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787432635.089725:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787432635.089888:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13810:1874258609462912:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787432635.089946:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:12516:x1874258588446720:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 257us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432635.089956:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 250 00000100:00080000:1.0:1787432635.090247:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432635.094333:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432635.094417:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588446976 00000100:00100000:3.0:1787432635.094427:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588446976 00000100:00100000:3.0:1787432635.094491:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 251 00000100:00100000:3.0:1787432635.094502:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+27:12516:x1874258588446976:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432635.094530:0:9020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432635.094553:0:9020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fbf0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5104 expref: -99 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432635.094669:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fbf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432635.094684:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432635.094701:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432635.094712:0:9020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787432635.095026:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fbf0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5104 expref: 30 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432635.095045:0:9020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fbf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5104 expref: 29 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432635.095071:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:3.0:1787432635.095074:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432635.095078:0:9020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f0e00, rc 0) 00000100:00100000:3.0:1787432635.095253:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+29:12516:x1874258588446976:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 751us (927us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787432635.095261:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 251 00000100:00100000:2.0:1787432635.097862:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432635.098016:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588447104 00000100:00100000:1.0:1787432635.098025:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588447104 00000100:00100000:1.0:1787432635.098089:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 19 00000100:00100000:1.0:1787432635.098099:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+29:2403:x1874258588447104:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432635.098124:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432635.098149:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0e00/0xca72b3b33563fbf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5104 expref: 29 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432635.098206:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:1.0:1787432635.098211:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432635.098259:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+28:2403:x1874258588447104:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 162us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432635.098267:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 19 00000100:00100000:1.0:1787432635.099922:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432635.100007:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588447360 00000100:00100000:2.0:1787432635.100014:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588447360 00000100:00100000:2.0:1787432635.100072:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 252 00000100:00100000:2.0:1787432635.100082:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+28:12516:x1874258588447360:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787432635.100159:0:10165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e4800/0xca72b3b33563fc05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432635.100207:0:10165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e4800/0xca72b3b33563fc05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432635.100235:0:10165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e4800/0xca72b3b33563fc05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432635.100401:0:10165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e4800/0xca72b3b33563fc05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432635.100409:0:10165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e4800/0xca72b3b33563fc05 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432635.100416:0:10165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e4800/0xca72b3b33563fc05 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432635.100422:0:10165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e4800 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432635.100426:0:10165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e4800/0xca72b3b33563fc05 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432635.100433:0:10165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e4800/0xca72b3b33563fc05 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432635.100446:0:10165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:2.0:1787432635.100448:0:10165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787432635.100452:0:10165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e4800/0xca72b3b33563fc05 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432635.100458:0:10165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e4800/0xca72b3b33563fc05 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432635.100574:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+29:12516:x1874258588447360:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 493us (658us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787432635.100583:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 252 00000040:00080000:3.0:1787432635.100817:0:13810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787432635.100822:0:13810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787432635.101983:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787432635.101995:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787432635.104152:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432635.104332:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588447616 00000100:00100000:1.0:1787432635.104341:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588447616 00000100:00100000:3.0:1787432635.104431:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 64 00000100:00100000:3.0:1787432635.104443:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+29:12516:x1874258588447616:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787432635.104885:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:12516:x1874258588447616:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 443us (740us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787432635.104893:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 64 00010000:00010000:2.0:1787432635.604405:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432636.622899:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787432636.853004:0:14771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787432636.853015:0:14771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787432636.853047:0:14771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787432636.853055:0:14771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787432637.058498:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432637.060247:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588447872 00000100:00100000:2.0:1787432637.060262:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588447872 00000100:00100000:2.0:1787432637.060653:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 253 00000100:00100000:2.0:1787432637.060664:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+30:12536:x1874258588447872:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432637.060688:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432637.060708:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e4800/0xca72b3b33563fc0c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d510b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432637.060851:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e5c00/0xca72b3b33563fc13 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432637.060867:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e5c00/0xca72b3b33563fc13 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432637.060882:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e5c00/0xca72b3b33563fc13 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432637.060893:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787432637.061002:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e4800/0xca72b3b33563fc0c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d510b expref: 33 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432637.061020:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e5c00/0xca72b3b33563fc13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d510b expref: 32 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432637.061030:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:2.0:1787432637.061033:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787432637.061036:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e5c00, rc 0) 00000100:00100000:2.0:1787432637.061104:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+32:12536:x1874258588447872:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 441us (2625us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787432637.061125:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 253 00000100:00080000:3.0:1787432637.062658:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432637.064273:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432637.064370:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588448000 00000100:00100000:3.0:1787432637.064379:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588448000 00000100:00100000:3.0:1787432637.064438:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 254 00000100:00100000:3.0:1787432637.064451:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+32:12536:x1874258588448000:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:3.0:1787432637.064540:0:9020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fc21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432637.064557:0:9020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fc21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432637.064584:0:9020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fc21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432637.064623:0:9020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fc21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432637.064630:0:9020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fc21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432637.064636:0:9020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fc21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432637.064642:0:9020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432637.064645:0:9020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fc21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432637.064652:0:9020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fc21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432637.064664:0:9020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:3.0:1787432637.064667:0:9020:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432637.064672:0:9020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fc21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432637.064678:0:9020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f1e00/0xca72b3b33563fc21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9020 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432637.064752:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+32:12536:x1874258588448000:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 303us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432637.064760:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 254 00000100:00100000:0.0:1787432637.117055:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432637.117356:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588448128 00000100:00100000:2.0:1787432637.117366:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588448128 00000100:00100000:2.0:1787432637.117446:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 79 00000100:00100000:2.0:1787432637.117457:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2402:x1874258588448128:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787432637.117474:0:8806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432637.117494:0:8806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c90c23/0xca72b3b33563fc28 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5112 expref: -99 pid: 8806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787432637.117519:0:8806:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a8a0eb8, atime: 0x6a8a0eb8, ctime: 0x6a8a0eb8, blocks: 0x8 00000100:00080000:1.0:1787432637.117621:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787432637.117703:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=448s v=(0 0) 00010000:00010000:2.0:1787432637.117708:0:8806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432637.117719:0:8806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c90c23/0xca72b3b33563fc28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5112 expref: 8 pid: 8806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432637.117739:0:8806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000048c90c23/0xca72b3b33563fc28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5112 expref: 8 pid: 8806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432637.117753:0:8806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e4800, rc 0) 00000100:00100000:2.0:1787432637.117812:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2402:x1874258588448128:12345-192.168.204.24@tcp:101:cat.0 Request processed in 357us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432637.117820:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 79 00000100:00100000:1.0:1787432637.125330:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432637.125504:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588448256 00000100:00100000:3.0:1787432637.125540:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588448256 00002000:00100000:3.0:1787432637.125601:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff948304461180 x1874258588448256/t0(0) o3->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:348/0 lens 488/0 e 0 to 0 dl 1787432648 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787432637.125614:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948304461180 with x1874258588448256 ext(0->4095) 00002000:00010000:3.0:1787432637.125620:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948304461180 00000100:00100000:3.0:1787432637.125704:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:3.0:1787432637.125715:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2403:x1874258588448256:12345-192.168.204.24@tcp:3:cat.0 00000100:00100000:3.0:1787432637.125892:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+8:2403:x1874258588448256:12345-192.168.204.24@tcp:3:cat.0 Request processed in 178us (572us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787432637.125900:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 7 00002000:00100000:3.0:1787432637.125907:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff948304461180 x1874258588448256/t0(0) o3->e37f63ac-9665-4d30-ad26-0faad6e6c7da@192.168.204.24@tcp:348/0 lens 488/4536 e 0 to 0 dl 1787432648 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787432637.125916:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff948304461180 with x1874258588448256 ext(0->4095) 00002000:00010000:3.0:1787432637.125920:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff948304461180 00000100:00100000:0.0:1787432637.388904:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432637.388929:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609463040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432637.389002:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432637.389281:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609463040 00000100:00100000:1.0:1787432637.389290:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609463040 00000100:00100000:0.0:1787432637.389403:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432637.389413:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609463168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432637.389460:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432637.389497:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609463168 00000100:00100000:0.0:1787432637.389500:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609463168 00000100:00100000:1.0:1787432637.389567:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787432637.389576:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1874258609463040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432637.389605:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432637.389655:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1874258609463040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432637.389664:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787432637.389732:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609463040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432637.389872:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432637.389884:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609463296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432637.389918:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432637.389957:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609463296 00000100:00100000:2.0:1787432637.389961:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609463296 00000100:00100000:2.0:1787432637.389989:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787432637.389996:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609463296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787432637.390035:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787432637.390075:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609463296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432637.390081:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787432637.390112:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609463296:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787432637.392595:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432637.392875:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787432637.392889:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609463168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787432637.392915:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432637.393009:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609463168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (3547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432637.393016:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787432637.393196:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609463168:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787432637.643400:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432637.900429:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432637.900453:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609463424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432637.900534:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432637.900599:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609463424 00000100:00100000:3.0:1787432637.900606:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609463424 00000100:00100000:3.0:1787432637.900661:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787432637.900671:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1874258609463424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787432637.900698:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787432637.900742:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1874258609463424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432637.900758:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1787432637.900782:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432637.900840:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609463424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432637.901055:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432637.901066:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609463552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787432637.901096:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432637.901130:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609463552 00000100:00100000:1.0:1787432637.901135:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609463552 00000100:00100000:1.0:1787432637.901184:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787432637.901197:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609463552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787432637.901208:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787432637.901249:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609463552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432637.901256:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787432637.901286:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609463552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432637.902249:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609463936:0@lo:400:kworker.0 00000100:00100000:3.0:1787432637.902295:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432637.902321:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609464448:0@lo:400:kworker.0 00000100:00100000:3.0:1787432637.902343:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432637.902371:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787432637.902377:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609463808:0@lo:400:kworker.0 00000100:00100000:3.0:1787432637.902398:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432637.902416:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609464320:0@lo:400:kworker.0 00000100:00100000:3.0:1787432637.902437:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432637.902463:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609463936 00000100:00100000:3.0:1787432637.902468:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609463936 00000100:00100000:3.0:1787432637.902502:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609464448 00000001:00080000:2.0:1787432637.902681:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1787432637.902693:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00080000:2.0:1787432637.902725:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432637.902737:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609464064:0@lo:400:kworker.0 00000100:00100000:2.0:1787432637.902768:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432637.902788:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609464576:0@lo:400:kworker.0 00000100:00100000:1.0:1787432637.902935:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609463808 00000100:00100000:1.0:1787432637.902940:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609463808 00000100:00100000:1.0:1787432637.902960:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609464320 00000100:00100000:1.0:1787432637.902963:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609464320 00000100:00100000:1.0:1787432637.902988:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1787432637.902996:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609463936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432637.903046:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609463936:12345-0@lo:400:kworker.0 Request processed in 50us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432637.903053:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1787432637.903070:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787432637.903076:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609463808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432637.903104:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609463808:12345-0@lo:400:kworker.0 Request processed in 29us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432637.903110:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787432637.903122:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1787432637.903128:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609464320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432637.903156:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609464320:12345-0@lo:400:kworker.0 Request processed in 28us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432637.903180:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00080000:1.0:1787432637.903204:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432637.903224:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609463680:0@lo:400:kworker.0 00000100:00100000:1.0:1787432637.903256:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432637.903297:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609464192:0@lo:400:kworker.0 00000100:00100000:1.0:1787432637.903320:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432637.903349:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609463680 00000100:00100000:1.0:1787432637.903353:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609463680 00000100:00100000:1.0:1787432637.903379:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1787432637.903385:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3642:x1874258609463680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432637.903417:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3642:x1874258609463680:12345-0@lo:400:kworker.0 Request processed in 32us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432637.903423:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1787432637.903461:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609463680:0@lo:400:kworker.0 00000100:00100000:1.0:1787432637.903485:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609464192 00000100:00100000:1.0:1787432637.903488:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609464192 00000100:00100000:2.0:1787432637.903993:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432637.904033:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609464448 00000100:00080000:0.0:1787432637.904183:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432637.904309:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609463808:0@lo:400:kworker.0 00010000:00080000:2.0:1787432637.904324:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948409d25c00 x1874258609464320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432637.904334:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609464320:0@lo:400:kworker.0 00000100:00100000:2.0:1787432637.904345:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609463936:0@lo:400:kworker.0 00000100:00100000:2.0:1787432637.904372:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609464064 00000100:00100000:2.0:1787432637.904377:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609464064 00000100:00100000:2.0:1787432637.904406:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787432637.904423:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609464064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432637.904467:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609464064:12345-0@lo:400:kworker.0 Request processed in 46us (1698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432637.904473:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787432637.904506:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609464064:0@lo:400:kworker.0 00000100:00100000:1.0:1787432637.904610:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609464576 00000100:00100000:1.0:1787432637.904615:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609464576 00000100:00100000:1.0:1787432637.904648:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1787432637.904656:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609464192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432637.904694:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609464192:12345-0@lo:400:kworker.0 Request processed in 39us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432637.904700:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1787432637.904713:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1787432637.904719:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609464448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432637.904752:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609464448:12345-0@lo:400:kworker.0 Request processed in 32us (2408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432637.904757:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1787432637.904770:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787432637.904777:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609464576:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787432637.905530:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432637.908940:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609464576:12345-0@lo:400:kworker.0 Request processed in 4156us (4939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432637.908955:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1787432637.909916:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609464192:0@lo:400:kworker.0 00010000:00080000:1.0:1787432637.910067:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948409d27100 x1874258609464576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432637.910079:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609464576:0@lo:400:kworker.0 00000100:00100000:0.0:1787432637.910218:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609464448:0@lo:400:kworker.0 00010000:00010000:2.0:1787432638.673989:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432639.435685:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609464704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432639.435765:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432639.436133:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609464704 00000100:00100000:0.0:1787432639.436143:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609464704 00000100:00100000:0.0:1787432639.436219:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787432639.436230:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609464704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432639.436270:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432639.436449:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609464704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 221us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432639.436456:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787432639.436574:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609464704:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787432639.692661:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787432639.954856:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00080000:2.0:1787432639.954885:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:2.0:1787432639.954896:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000020:00080000:1.0:1787432639.954897:0:6492:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff948304743480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787432639.954904:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94840878f300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff948304743a80 00000020:00080000:1.0:1787432639.954908:0:6492:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94840878f800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff948420439200 00000020:00080000:2.0:1787432639.954924:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:1.0:1787432639.954926:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:3.0:1787432639.955052:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fba3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432639.955064:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fba3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432639.955072:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fba3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432639.955077:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432639.955088:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fba3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432639.955095:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fba3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432639.955113:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff948411a6bd00) 00010000:00010000:3.0:1787432639.955115:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432639.955119:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fba3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432639.955125:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fba3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787432639.955255:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1787432640.024754:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432640.024857:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432640.024892:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432640.024931:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432640.024988:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588448896 00000100:00100000:0.0:1787432640.024999:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588448896 00000100:00100000:0.0:1787432640.025062:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 104 00000100:00100000:0.0:1787432640.025072:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2400:x1874258588448896:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432640.025157:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2400:x1874258588448896:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 87us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432640.025209:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 104 00000100:00080000:0.0:1787432640.025232:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432640.029466:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588448384 00000100:00100000:2.0:1787432640.029479:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588448384 00000100:00100000:2.0:1787432640.029537:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 401 00000100:00100000:2.0:1787432640.029547:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588448384:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432640.029626:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588448384:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 80us (4883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432640.029633:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 401 00000100:00100000:2.0:1787432640.029707:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432640.035032:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588448640 00000100:00100000:0.0:1787432640.035032:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588449152 00000100:00100000:0.0:1787432640.035048:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588449152 00000100:00100000:3.0:1787432640.035053:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588448640 00000100:00100000:0.0:1787432640.035189:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 375 00000100:00100000:0.0:1787432640.035200:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588449152:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432640.035281:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588449152:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 84us (10351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432640.035290:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 375 00000100:00100000:3.0:1787432640.035572:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 376 00000100:00100000:3.0:1787432640.035582:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588448640:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432640.035681:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588448640:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 100us (10822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432640.035688:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 376 00000100:00080000:1.0:1787432640.035884:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787432640.036150:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432640.036207:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432640.036257:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588448768 00000100:00100000:3.0:1787432640.036262:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588448768 00000100:00100000:3.0:1787432640.036299:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 105 00000100:00100000:3.0:1787432640.036307:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588448768:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432640.036343:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2400:x1874258588448768:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 36us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432640.036350:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 105 00000100:00080000:0.0:1787432640.036563:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432640.036803:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588448512 00000100:00100000:1.0:1787432640.036809:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588448512 00000100:00100000:1.0:1787432640.036857:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588449024 00000100:00100000:1.0:1787432640.036860:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588449024 00000100:00100000:1.0:1787432640.036880:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 377 00000100:00100000:1.0:1787432640.036887:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:2400:x1874258588448512:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432640.036948:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:2400:x1874258588448512:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 51us (7230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432640.036955:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 377 00000100:00100000:1.0:1787432640.036968:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 378 00000100:00100000:1.0:1787432640.036974:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588449024:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432640.036994:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2400:x1874258588449024:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 21us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432640.037000:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 378 00000100:00080000:2.0:1787432640.037638:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787432640.716490:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432641.740441:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432642.202920:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432642.203153:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588449280 00000100:00100000:0.0:1787432642.203208:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588449280 00000100:00100000:0.0:1787432642.203277:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 255 00000100:00100000:0.0:1787432642.203288:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:12180:x1874258588449280:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787432642.203402:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:12180:x1874258588449280:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 116us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432642.203411:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 255 00000100:00080000:2.0:1787432642.203892:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432642.205266:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432642.205396:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588449408 00000100:00100000:0.0:1787432642.205405:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588449408 00000100:00100000:0.0:1787432642.205489:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 256 00000100:00100000:0.0:1787432642.205500:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:12180:x1874258588449408:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787432642.205606:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:12180:x1874258588449408:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 108us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432642.205615:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 256 00000100:00080000:2.0:1787432642.205824:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787432642.208112:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432642.208291:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588449664 00000100:00100000:1.0:1787432642.208303:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588449664 00000100:00100000:1.0:1787432642.208368:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 65 00000100:00100000:1.0:1787432642.208379:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:12180:x1874258588449664:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787432642.208645:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:12180:x1874258588449664:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 267us (543us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787432642.208653:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 65 00000100:00100000:1.0:1787432642.496326:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432642.496540:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588449792 00000100:00100000:0.0:1787432642.496551:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588449792 00000100:00100000:0.0:1787432642.496647:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 257 00000100:00100000:0.0:1787432642.496659:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:12993:x1874258588449792:12345-192.168.204.24@tcp:101:lsof.0 00010000:00010000:0.0:1787432642.496682:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432642.496705:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563fc2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5119 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432642.496783:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fc36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432642.496796:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fc36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432642.496810:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fc36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432642.496857:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787432642.496860:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787432642.496881:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fc36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432642.496904:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489e00/0xca72b3b33563fc2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5119 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432642.496923:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fc36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5119 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432642.496933:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9483032ad500) 00010000:00010000:0.0:1787432642.496936:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787432642.496969:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304488e00, rc 0) 00000100:00100000:0.0:1787432642.497034:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:12993:x1874258588449792:12345-192.168.204.24@tcp:101:lsof.0 Request processed in 377us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432642.497042:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 257 00000100:00080000:2.0:1787432642.498064:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432642.507611:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609464832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432642.507698:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432642.507834:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609464832 00000100:00100000:3.0:1787432642.507842:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609464832 00000100:00100000:3.0:1787432642.507908:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787432642.507920:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609464832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432642.507952:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432642.508011:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609464832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432642.508018:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1787432642.508081:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432642.508119:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1787432642.508125:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1787432642.508150:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff948303adb480, transno 4294967311 00000100:00100000:1.0:1787432642.508197:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609464832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432642.508654:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432642.508680:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609464960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432642.508715:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432642.508804:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609464960 00000100:00100000:3.0:1787432642.508810:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609464960 00000100:00100000:3.0:1787432642.508861:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787432642.508869:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609464960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787432642.508882:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787432642.508918:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609464960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432642.508924:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:1.0:1787432642.509206:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432642.509239:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609464960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432642.509647:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432642.509660:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609465088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432642.509701:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432642.509797:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609465088 00000100:00100000:3.0:1787432642.509803:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609465088 00000100:00100000:3.0:1787432642.509843:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787432642.509850:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609465088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787432642.509883:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787432642.509928:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609465088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432642.509935:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787432642.510385:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609465088:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787432642.764641:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787432643.019918:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787432643.020613:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432643.020633:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609465216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432643.020724:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432643.020806:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609465216 00000100:00100000:2.0:1787432643.020813:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609465216 00000100:00100000:2.0:1787432643.020866:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787432643.020875:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609465216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432643.020903:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787432643.020945:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609465216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432643.020952:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:2.0:1787432643.020973:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432643.021013:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1787432643.021019:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1787432643.021045:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609465216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432643.023208:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609465344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787432643.023289:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432643.023581:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609465344 00000100:00100000:0.0:1787432643.023590:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609465344 00000100:00100000:0.0:1787432643.023662:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787432643.023673:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609465344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787432643.023697:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:2.0:1787432643.024357:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432643.028403:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609465472:0@lo:400:kworker.0 00000100:00100000:2.0:1787432643.028505:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432643.028602:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609465472 00000100:00100000:2.0:1787432643.028610:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609465472 00000100:00100000:2.0:1787432643.028670:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1787432643.028680:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3644:x1874258609465472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432643.028749:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3644:x1874258609465472:12345-0@lo:400:kworker.0 Request processed in 70us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432643.028757:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1787432643.028808:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609465472:0@lo:400:kworker.0 00000100:00100000:0.0:1787432643.039876:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609465344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 16195us (16577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432643.039892:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787432643.040871:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609465344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432643.041181:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432643.041212:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609465600:0@lo:400:kworker.0 00000100:00100000:3.0:1787432643.041283:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432643.041331:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609465600 00000100:00100000:3.0:1787432643.041337:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609465600 00000100:00100000:3.0:1787432643.041388:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1787432643.041397:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609465600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432643.041458:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609465600:12345-0@lo:400:kworker.0 Request processed in 62us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432643.041465:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1787432643.041498:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609465600:0@lo:400:kworker.0 00000100:00100000:3.0:1787432643.041880:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609465728:0@lo:400:kworker.0 00000100:00100000:3.0:1787432643.041909:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432643.041941:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609465728 00000100:00100000:3.0:1787432643.041944:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609465728 00000100:00100000:3.0:1787432643.041967:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787432643.041973:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609465728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432643.042073:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609465728:12345-0@lo:400:kworker.0 Request processed in 100us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432643.042079:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787432643.042105:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609465728:0@lo:400:kworker.0 00000100:00100000:3.0:1787432643.042144:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432643.042149:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609466112:0@lo:400:kworker.0 00000100:00100000:3.0:1787432643.042194:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432643.042215:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609466112 00000100:00100000:3.0:1787432643.042217:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609466112 00000100:00100000:3.0:1787432643.042248:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1787432643.042265:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609466112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432643.042298:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609466112:12345-0@lo:400:kworker.0 Request processed in 35us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432643.042305:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00080000:3.0:1787432643.042321:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432643.042340:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609466112:0@lo:400:kworker.0 00000100:00100000:3.0:1787432643.042372:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609466240:0@lo:400:kworker.0 00000100:00100000:3.0:1787432643.042393:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432643.042661:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609465856:0@lo:400:kworker.0 00000100:00100000:1.0:1787432643.042693:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432643.042731:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609466240 00000100:00100000:1.0:1787432643.042735:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609466240 00000100:00100000:1.0:1787432643.042770:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609465856 00000100:00100000:1.0:1787432643.042773:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609465856 00000100:00100000:1.0:1787432643.042792:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1787432643.042800:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609466240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432643.042829:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609466240:12345-0@lo:400:kworker.0 Request processed in 32us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432643.042834:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1787432643.042845:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1787432643.042851:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609465856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432643.042888:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609465856:12345-0@lo:400:kworker.0 Request processed in 37us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432643.042894:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00080000:1.0:1787432643.042912:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432643.042932:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609465856:0@lo:400:kworker.0 00000100:00100000:1.0:1787432643.042945:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432643.042951:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609465984:0@lo:400:kworker.0 00000100:00100000:1.0:1787432643.042976:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432643.043015:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609465984 00000100:00100000:1.0:1787432643.043019:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609465984 00000100:00100000:1.0:1787432643.043042:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787432643.043048:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609465984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432643.043077:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609465984:12345-0@lo:400:kworker.0 Request processed in 29us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432643.043083:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787432643.043106:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609465984:0@lo:400:kworker.0 00010000:00080000:3.0:1787432643.044218:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948409d27100 x1874258609466240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432643.044231:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609466240:0@lo:400:kworker.0 00000100:00100000:3.0:1787432643.044305:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432643.044314:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609466624:0@lo:400:kworker.0 00000100:00100000:3.0:1787432643.044356:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432643.044391:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609466624 00000100:00100000:3.0:1787432643.044397:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609466624 00000100:00100000:3.0:1787432643.044756:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1787432643.044764:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609466624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432643.044813:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609466624:12345-0@lo:400:kworker.0 Request processed in 49us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432643.044819:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00080000:3.0:1787432643.044843:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432643.044861:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609466624:0@lo:400:kworker.0 00000100:00100000:3.0:1787432643.044897:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609466752:0@lo:400:kworker.0 00000100:00100000:3.0:1787432643.045059:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432643.045090:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609466752 00000100:00100000:3.0:1787432643.045094:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609466752 00000100:00100000:3.0:1787432643.045126:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1787432643.045132:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609466752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432643.045191:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609466752:12345-0@lo:400:kworker.0 Request processed in 59us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432643.045197:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00080000:3.0:1787432643.045210:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787432643.045225:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948409d27b80 x1874258609466752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432643.045235:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609466752:0@lo:400:kworker.0 00000100:00100000:1.0:1787432643.045416:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609466496:0@lo:400:kworker.0 00000100:00100000:1.0:1787432643.045452:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432643.045483:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432643.045489:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609466368:0@lo:400:kworker.0 00000100:00100000:1.0:1787432643.045512:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432643.045590:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609466496 00000100:00100000:0.0:1787432643.045594:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609466496 00000100:00100000:0.0:1787432643.045630:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609466368 00000100:00100000:0.0:1787432643.045633:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609466368 00000100:00100000:0.0:1787432643.045650:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787432643.045658:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609466496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432643.045697:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609466496:12345-0@lo:400:kworker.0 Request processed in 40us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432643.045703:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787432643.045756:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787432643.045763:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609466368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432643.045791:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609466368:12345-0@lo:400:kworker.0 Request processed in 29us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432643.045797:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787432643.048215:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609466368:0@lo:400:kworker.0 00000100:00100000:1.0:1787432643.048237:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609466496:0@lo:400:kworker.0 00000040:00080000:1.0:1787432643.276961:0:13810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787432643.276984:0:13810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787432643.277138:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1787432643.277146:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787432643.787447:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432644.555721:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609466880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432644.555794:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432644.556691:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609466880 00000100:00100000:0.0:1787432644.556700:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609466880 00000100:00100000:0.0:1787432644.556766:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787432644.556777:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609466880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432644.556814:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787432644.560481:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609466880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3696us (4677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432644.560497:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787432644.565949:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609466880:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787432644.814462:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432645.147666:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432645.147734:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432645.147773:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432645.147803:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432645.147831:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432645.147850:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432645.147873:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432645.147897:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588450432 00000100:00100000:3.0:1787432645.147900:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588450176 00000100:00100000:3.0:1787432645.147909:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588450176 00000100:00100000:0.0:1787432645.147909:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588450432 00000100:00100000:0.0:1787432645.147980:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588450304 00000100:00100000:0.0:1787432645.147984:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588450304 00000100:00100000:1.0:1787432645.147992:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588449920 00000100:00100000:1.0:1787432645.147998:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588449920 00000100:00100000:2.0:1787432645.148039:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588450688 00000100:00100000:2.0:1787432645.148064:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588450688 00000100:00100000:1.0:1787432645.148114:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 403 00000100:00100000:1.0:1787432645.148135:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:2401:x1874258588449920:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432645.148240:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+13:2401:x1874258588449920:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 107us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432645.148248:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 403 00000100:00100000:1.0:1787432645.148281:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 108 00000100:00100000:1.0:1787432645.148288:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2401:x1874258588450432:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432645.148315:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2401:x1874258588450432:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432645.148321:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 108 00000100:00100000:3.0:1787432645.153920:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588450048 00000100:00100000:3.0:1787432645.153935:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588450048 00000100:00100000:3.0:1787432645.154275:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588450560 00000100:00100000:3.0:1787432645.154643:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588450560 00000100:00100000:3.0:1787432645.154926:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 385 00000100:00100000:3.0:1787432645.154939:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588450176:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432645.155741:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588450176:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 802us (8002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432645.155752:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 385 00000100:00100000:3.0:1787432645.155782:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 386 00000100:00100000:3.0:1787432645.155793:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:2401:x1874258588450048:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432645.155827:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:2401:x1874258588450048:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 38us (7996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432645.155833:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 386 00000100:00100000:3.0:1787432645.155846:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 387 00000100:00100000:3.0:1787432645.155853:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2401:x1874258588450560:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432645.157826:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2401:x1874258588450560:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1961us (9939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432645.157840:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 387 00000100:00100000:0.0:1787432645.163504:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 109 00000100:00100000:0.0:1787432645.163525:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588450304:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432645.163616:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588450304:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 99us (15763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432645.163624:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 109 00000100:00100000:2.0:1787432645.168933:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 388 00000100:00100000:2.0:1787432645.168974:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588450688:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432645.169235:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588450688:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 285us (21429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432645.169244:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 388 00000100:00080000:1.0:1787432645.169577:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432645.169584:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787432645.169586:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432645.169589:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787432645.835447:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787432646.098128:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:1.0:1787432646.098143:0:6492:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787432646.098242:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787432646.098254:0:6545:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:2.0:1787432646.499409:0:14969:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 17:04:04 (1787432644) 00010000:00010000:2.0:1787432646.859457:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432647.641056:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609467008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432647.641125:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432647.641220:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609467008 00000100:00100000:2.0:1787432647.641227:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609467008 00000100:00100000:1.0:1787432647.642278:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609467136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432647.642338:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432647.642894:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432647.642903:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609467264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432647.642931:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432647.646859:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787432647.646878:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609467008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787432647.646976:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787432647.647212:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609467008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 339us (6086us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432647.647221:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787432647.647367:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609467008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432647.647499:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609467136 00000100:00100000:2.0:1787432647.647507:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609467136 00000100:00100000:2.0:1787432647.647588:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609467264 00000100:00100000:2.0:1787432647.647592:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609467264 00000100:00100000:0.0:1787432647.647707:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1787432647.647714:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432647.647719:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609467136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787432647.647741:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432647.647794:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609467136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (5455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432647.647801:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787432647.647815:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787432647.647836:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304646680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609467264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432647.647847:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432647.647886:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304646680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609467264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (4954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432647.647892:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787432647.647965:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609467264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432647.647978:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609467136:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787432647.884529:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432648.139782:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432648.139807:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609467392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432648.139873:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432648.139942:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609467392 00000100:00100000:2.0:1787432648.139950:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609467392 00000100:00100000:2.0:1787432648.140018:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787432648.140028:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609467392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787432648.140056:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787432648.140101:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609467392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432648.140108:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787432648.140151:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609467392:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787432648.140512:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432648.140557:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432648.140569:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609467520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432648.140621:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432648.140749:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609467520 00000100:00100000:1.0:1787432648.140754:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609467520 00000100:00100000:1.0:1787432648.140799:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787432648.140808:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609467520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787432648.140820:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787432648.140858:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609467520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432648.140865:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787432648.140898:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609467520:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787432648.140953:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432648.147807:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609467904:0@lo:400:kworker.0 00000100:00100000:1.0:1787432648.147889:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432648.147968:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609468032:0@lo:400:kworker.0 00000100:00100000:1.0:1787432648.148199:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432648.148248:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609468032 00000100:00100000:1.0:1787432648.148259:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609468032 00000100:00100000:1.0:1787432648.148428:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1787432648.148456:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609468032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432648.148524:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609468032:12345-0@lo:400:kworker.0 Request processed in 87us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432648.148532:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1787432648.150498:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609468032:0@lo:400:kworker.0 00000100:00100000:3.0:1787432648.150871:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609467776:0@lo:400:kworker.0 00000100:00100000:3.0:1787432648.150937:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432648.150981:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432648.150988:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609467648:0@lo:400:kworker.0 00000100:00100000:3.0:1787432648.151063:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432648.151102:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609467776 00000100:00100000:3.0:1787432648.151111:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609467776 00000100:00100000:3.0:1787432648.151216:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1787432648.151236:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609467776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432648.151296:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609467776:12345-0@lo:400:kworker.0 Request processed in 71us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432648.151304:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1787432648.151360:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609467648 00000100:00100000:3.0:1787432648.151364:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609467648 00000100:00100000:3.0:1787432648.151419:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1787432648.151426:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3642:x1874258609467648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432648.151453:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3642:x1874258609467648:12345-0@lo:400:kworker.0 Request processed in 28us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432648.151458:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1787432648.151496:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609467648:0@lo:400:kworker.0 00000100:00100000:3.0:1787432648.151507:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609467776:0@lo:400:kworker.0 00000100:00100000:1.0:1787432648.152483:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432648.152497:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609468160:0@lo:400:kworker.0 00000100:00100000:1.0:1787432648.152541:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432648.152699:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609467904 00000100:00100000:0.0:1787432648.152705:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609467904 00000100:00100000:0.0:1787432648.152753:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609468160 00000100:00100000:0.0:1787432648.152757:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609468160 00000100:00100000:0.0:1787432648.152772:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787432648.152779:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609467904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432648.152830:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609467904:12345-0@lo:400:kworker.0 Request processed in 51us (4941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432648.152837:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787432648.152852:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787432648.152859:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609468160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432648.158036:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609468160:12345-0@lo:400:kworker.0 Request processed in 5162us (5480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432648.158056:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787432648.158109:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609468288:0@lo:400:kworker.0 00000100:00100000:3.0:1787432648.158222:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432648.158234:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609467904:0@lo:400:kworker.0 00000100:00100000:0.0:1787432648.159636:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609468288 00000100:00100000:0.0:1787432648.159647:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609468288 00000100:00100000:0.0:1787432648.159773:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1787432648.159793:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609468288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432648.160102:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432648.160119:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609468416:0@lo:400:kworker.0 00000100:00100000:1.0:1787432648.160196:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432648.160241:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609468416 00000100:00100000:1.0:1787432648.160245:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609468416 00000100:00100000:1.0:1787432648.160278:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1787432648.160287:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609468416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432648.160342:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609468416:12345-0@lo:400:kworker.0 Request processed in 57us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432648.160350:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00010000:00080000:1.0:1787432648.160395:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948304644000 x1874258609468416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432648.160409:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609468416:0@lo:400:kworker.0 00000100:00100000:1.0:1787432648.160442:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609468544:0@lo:400:kworker.0 00000100:00100000:1.0:1787432648.160466:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432648.160494:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609468544 00000100:00100000:1.0:1787432648.160498:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609468544 00000100:00100000:1.0:1787432648.160525:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787432648.160541:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609468544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432648.162390:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609468544:12345-0@lo:400:kworker.0 Request processed in 1179us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432648.162406:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787432648.162486:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609468544:0@lo:400:kworker.0 00000100:00100000:1.0:1787432648.162561:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432648.162569:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609468928:0@lo:400:kworker.0 00000100:00100000:1.0:1787432648.162837:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432648.162878:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609468928 00000100:00100000:1.0:1787432648.162883:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609468928 00000100:00100000:1.0:1787432648.162926:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1787432648.162935:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609468928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432648.162982:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609468928:12345-0@lo:400:kworker.0 Request processed in 48us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432648.162989:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00010000:00080000:1.0:1787432648.163102:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948304647100 x1874258609468928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432648.163114:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609468928:0@lo:400:kworker.0 00000100:00080000:1.0:1787432648.165242:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432648.165254:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432648.168836:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609468288:12345-0@lo:400:kworker.0 Request processed in 9036us (10605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432648.168852:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1787432648.168911:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609468672:0@lo:400:kworker.0 00000100:00100000:0.0:1787432648.168978:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432648.169019:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432648.169027:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609468800:0@lo:400:kworker.0 00000100:00100000:0.0:1787432648.169054:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432648.169104:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609468672 00000100:00100000:0.0:1787432648.169112:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609468672 00000100:00100000:0.0:1787432648.169159:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787432648.169187:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609468800 00000100:00100000:0.0:1787432648.169190:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609468672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432648.169195:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609468800 00000100:00100000:1.0:1787432648.169244:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787432648.169252:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609468672:12345-0@lo:400:kworker.0 Request processed in 64us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432648.169256:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609468800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432648.169275:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787432648.169302:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609468800:12345-0@lo:400:kworker.0 Request processed in 49us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432648.169323:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609468800:0@lo:400:kworker.0 00000100:00100000:1.0:1787432648.169339:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787432648.169340:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609468672:0@lo:400:kworker.0 00000100:00080000:1.0:1787432648.169362:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432648.174432:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609468160:0@lo:400:kworker.0 00000100:00100000:3.0:1787432648.174490:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609468288:0@lo:400:kworker.0 00010000:00010000:1.0:1787432648.907510:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432649.676890:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432649.676912:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609469056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432649.676978:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432649.677154:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609469056 00000100:00100000:2.0:1787432649.677185:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609469056 00000100:00100000:2.0:1787432649.677232:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787432649.677240:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609469056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787432649.677269:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787432649.677319:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609469056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432649.677326:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787432649.677545:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609469056:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787432649.938682:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432650.262260:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432650.262311:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432650.262452:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588450944 00000100:00100000:1.0:1787432650.262463:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588450944 00000100:00100000:1.0:1787432650.262555:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 395 00000100:00100000:1.0:1787432650.262568:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:2400:x1874258588450944:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432650.262658:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:2400:x1874258588450944:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 94us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432650.262666:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 395 00000100:00080000:0.0:1787432650.262859:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432650.263188:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588450816 00000100:00100000:3.0:1787432650.263195:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588450816 00000100:00100000:3.0:1787432650.263241:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 405 00000100:00100000:3.0:1787432650.263251:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588450816:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432650.263298:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a40dc378-0ae8-4eb1-a992-02a683490593+13:2400:x1874258588450816:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 48us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432650.263322:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 405 00000100:00100000:3.0:1787432650.264132:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432650.264259:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432650.264290:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432650.264311:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432650.264341:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588451200 00000100:00100000:3.0:1787432650.264344:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432650.264347:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588451200 00000100:00100000:2.0:1787432650.264423:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588451328 00000100:00100000:2.0:1787432650.264427:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588451328 00000100:00100000:2.0:1787432650.264476:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 112 00000100:00100000:2.0:1787432650.264486:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2401:x1874258588451328:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432650.264548:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2401:x1874258588451328:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 64us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432650.264556:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 112 00000100:00100000:1.0:1787432650.265259:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 113 00000100:00100000:1.0:1787432650.265270:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588451200:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432650.265315:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588451200:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 48us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432650.265322:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 113 00000100:00080000:1.0:1787432650.265410:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787432650.265415:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432650.266684:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588451456 00000100:00100000:0.0:1787432650.266704:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588451456 00000100:00100000:0.0:1787432650.266797:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588451072 00000100:00100000:0.0:1787432650.266801:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588451072 00000100:00100000:0.0:1787432650.266828:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 396 00000100:00100000:0.0:1787432650.266837:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2401:x1874258588451456:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432650.266904:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2401:x1874258588451456:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 68us (2645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432650.266927:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 396 00000100:00100000:0.0:1787432650.266947:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 397 00000100:00100000:0.0:1787432650.266955:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588451072:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432650.266981:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2401:x1874258588451072:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (2691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432650.266988:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 397 00000100:00080000:1.0:1787432650.267202:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432650.267207:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432650.275632:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588451584 00000100:00100000:1.0:1787432650.275649:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588451584 00000100:00100000:1.0:1787432650.275737:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 398 00000100:00100000:1.0:1787432650.275750:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588451584:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432650.275831:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2401:x1874258588451584:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 84us (11486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432650.275853:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 398 00000100:00080000:3.0:1787432650.276667:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787432650.765398:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432650.767237:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588451840 00000100:00100000:1.0:1787432650.767256:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588451840 00000100:00100000:1.0:1787432650.767345:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 66 00000100:00100000:1.0:1787432650.767359:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+18:13217:x1874258588451840:12345-192.168.204.24@tcp:35:umount.0 00000100:00100000:1.0:1787432650.767773:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:13217:x1874258588451840:12345-192.168.204.24@tcp:35:umount.0 Request processed in 416us (2384us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1787432650.767782:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 66 00000100:00100000:1.0:1787432650.773030:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432650.773881:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588452096 00000100:00100000:3.0:1787432650.773892:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588452096 00000100:00100000:3.0:1787432650.773956:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 67 00000100:00100000:3.0:1787432650.773966:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+19:13217:x1874258588452096:12345-192.168.204.24@tcp:35:umount.0 00000100:00100000:3.0:1787432650.774311:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:13217:x1874258588452096:12345-192.168.204.24@tcp:35:umount.0 Request processed in 345us (1295us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787432650.774320:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 67 00000100:00100000:3.0:1787432650.777349:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432650.777457:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588452352 00000100:00100000:1.0:1787432650.777468:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588452352 00000100:00100000:1.0:1787432650.777530:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 68 00000100:00100000:1.0:1787432650.777541:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948411a1e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+20:13217:x1874258588452352:12345-192.168.204.24@tcp:35:umount.0 00000100:00100000:1.0:1787432650.777815:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948411a1e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:13217:x1874258588452352:12345-192.168.204.24@tcp:35:umount.0 Request processed in 274us (474us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787432650.777824:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 68 00000100:00100000:0.0:1787432650.781975:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432650.782199:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588452608 00000100:00100000:1.0:1787432650.782209:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588452608 00000100:00100000:1.0:1787432650.782268:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 69 00000100:00100000:1.0:1787432650.782278:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:13217:x1874258588452608:12345-192.168.204.24@tcp:35:umount.0 00000100:00100000:1.0:1787432650.782576:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:13217:x1874258588452608:12345-192.168.204.24@tcp:35:umount.0 Request processed in 297us (608us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1787432650.782585:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 69 00000100:00100000:2.0:1787432650.786689:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432650.788041:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588452992 00000100:00100000:1.0:1787432650.788069:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588452992 00000100:00100000:1.0:1787432650.788134:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 80 00000100:00100000:1.0:1787432650.788144:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+7:2399:x1874258588452992:12345-192.168.204.24@tcp:9:umount.0 00000020:00000080:1.0:1787432650.788211:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563f1a1 00000020:00010000:1.0:1787432650.788221:0:8430:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9483025b3800: total 0 00000100:00080000:1.0:1787432650.788226:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9483025b4800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787432650.788932:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432650.788969:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432650.789018:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588453248 00000100:00100000:2.0:1787432650.789033:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588453248 00000100:00100000:3.0:1787432650.789042:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432650.789064:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588453120 00000100:00100000:3.0:1787432650.789068:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588453120 00000100:00100000:3.0:1787432650.789088:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588453376 00000100:00100000:3.0:1787432650.789090:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588453376 00000100:00100000:2.0:1787432650.789091:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00100000:2.0:1787432650.789099:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a40dc378-0ae8-4eb1-a992-02a683490593+15:2403:x1874258588453248:12345-192.168.204.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787432650.789102:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:3.0:1787432650.789108:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a40dc378-0ae8-4eb1-a992-02a683490593+15:2403:x1874258588453120:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432650.789111:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432650.789114:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432650.789129:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fc800/0xca72b3b33563ec0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c6c expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432650.789129:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948401683600/0xca72b3b33563eb50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c2d expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432650.789145:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432650.789145:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432650.789220:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a40dc378-0ae8-4eb1-a992-02a683490593+13:2403:x1874258588453120:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 110us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432650.789227:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:3.0:1787432650.789244:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:3.0:1787432650.789253:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a40dc378-0ae8-4eb1-a992-02a683490593+12:2403:x1874258588453376:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432650.789261:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432650.789270:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303012600/0xca72b3b33563ee60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d45 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432650.789279:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:1.0:1787432650.789642:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1787432650.789859:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a40dc378-0ae8-4eb1-a992-02a683490593+11:2403:x1874258588453248:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 697us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432650.789869:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 20 00000020:00010000:0.0:1787432650.791060:0:6501:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9483025b3800: total 0 00010000:00010000:0.0:1787432650.791121:0:6501:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9483025b3800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787432650.791207:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c90c23/0xca72b3b33563fc28 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5112 expref: 6 pid: 8806 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432650.791245:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9723fb4/0xca72b3b33563f559 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f2f expref: 5 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432650.791275:0:6501:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9483025b3800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787432650.791289:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432650.791291:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432650.791293:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432650.793461:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e37f63ac-9665-4d30-ad26-0faad6e6c7da+2:2399:x1874258588452992:12345-192.168.204.24@tcp:9:umount.0 Request processed in 5307us (6772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432650.793463:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a40dc378-0ae8-4eb1-a992-02a683490593+10:2403:x1874258588453376:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 4211us (4420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432650.793475:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:1.0:1787432650.793475:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 80 00000100:00100000:2.0:1787432650.810251:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432650.810451:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588453504 00000100:00100000:1.0:1787432650.810461:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588453504 00000100:00100000:1.0:1787432650.810523:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 81 00000100:00100000:1.0:1787432650.810535:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2399:x1874258588453504:12345-192.168.204.24@tcp:9:umount.0 00000020:00000080:1.0:1787432650.810575:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ef2b 00000100:00080000:1.0:1787432650.810586:0:8431:0:(import.c:65:import_set_state_nolock()) ffff948416487000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787432650.810641:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787432650.810815:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e37f63ac-9665-4d30-ad26-0faad6e6c7da+2:2399:x1874258588453504:12345-192.168.204.24@tcp:9:umount.0 Request processed in 282us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432650.810823:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 81 00010000:00010000:2.0:1787432650.811033:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432650.821794:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432650.821961:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588454528 00000100:00100000:0.0:1787432650.821972:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588454528 00000100:00100000:0.0:1787432650.822038:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 258 00000100:00100000:0.0:1787432650.822050:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+22:2399:x1874258588454528:12345-192.168.204.24@tcp:39:umount.0 00000020:00000080:0.0:1787432650.822083:0:9020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563eb5e 00000020:00010000:0.0:1787432650.822099:0:9020:0:(genops.c:1921:obd_stale_export_put()) Put export ffff948303550800: total 0 00000100:00080000:0.0:1787432650.822104:0:9020:0:(import.c:65:import_set_state_nolock()) ffff948303552000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787432650.822132:0:9020:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1787432650.822342:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e37f63ac-9665-4d30-ad26-0faad6e6c7da+21:2399:x1874258588454528:12345-192.168.204.24@tcp:39:umount.0 Request processed in 294us (558us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1787432650.822351:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 258 00000020:00010000:2.0:1787432650.823657:0:9519:0:(genops.c:1907:obd_stale_export_get()) Get export ffff948303550800: total 0 00010000:00010000:2.0:1787432650.823730:0:9519:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff948303550800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787432650.823768:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:2.0:1787432650.823772:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787432650.823782:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488000/0xca72b3b33563f544 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f28 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432650.823812:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9483032ad500) 00010000:00010000:2.0:1787432650.823815:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432650.823819:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850800/0xca72b3b33563f5c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f4b expref: 19 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432650.823834:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94841318b400) 00010000:00010000:2.0:1787432650.823836:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432650.823840:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850600/0xca72b3b33563eea6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d5a expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432650.823874:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:2.0:1787432650.823877:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432650.823880:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33563f51a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f1a expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432650.823900:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:2.0:1787432650.823903:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787432650.823907:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9483039f0200/0xca72b3b33563fb09 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50c5 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432650.823936:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:2.0:1787432650.823939:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787432650.823943:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e800/0xca72b3b33563f1fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4e48 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432650.823956:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94841318b900) 00010000:00010000:2.0:1787432650.823958:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432650.823962:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948303850200/0xca72b3b33563ee8a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d53 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432650.823976:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:2.0:1787432650.823978:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787432650.823982:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489800/0xca72b3b33563f5de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4f52 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432650.823994:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff948420766d00) 00010000:00010000:2.0:1787432650.823996:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787432650.824006:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f800/0xca72b3b33563f43a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4ee2 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432650.824028:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9483026f7000) 00010000:00010000:2.0:1787432650.824030:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787432650.824034:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b33563f8cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d502b expref: 11 pid: 10165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432650.824049:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:2.0:1787432650.824052:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432650.824055:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e5200/0xca72b3b33563fbe9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d50fd expref: 10 pid: 9020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432650.824067:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9483032ada00) 00010000:00010000:2.0:1787432650.824070:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787432650.824073:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484032e5c00/0xca72b3b33563fc13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d510b expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432650.824088:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff948435957300) 00010000:00010000:2.0:1787432650.824090:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787432650.824094:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948400030200/0xca72b3b33563ef01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d6f expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432650.824105:0:9519:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff948303550800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1787432650.824121:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432650.824124:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432650.824125:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432650.831393:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432650.831599:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588454656 00000100:00100000:1.0:1787432650.831609:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588454656 00000100:00100000:1.0:1787432650.831667:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 259 00000100:00100000:1.0:1787432650.831678:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+5:2399:x1874258588454656:12345-192.168.204.24@tcp:39:umount.0 00000020:00000080:1.0:1787432650.831720:0:10165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563eb65 00000100:00080000:1.0:1787432650.831738:0:10165:0:(import.c:65:import_set_state_nolock()) ffff948303556800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787432650.831767:0:10165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787432650.831969:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e37f63ac-9665-4d30-ad26-0faad6e6c7da+3:2399:x1874258588454656:12345-192.168.204.24@tcp:39:umount.0 Request processed in 291us (585us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787432650.831977:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 259 00010000:00010000:0.0:1787432650.832127:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432650.955584:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432651.980000:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432652.591130:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432652.591215:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432652.591268:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432652.591720:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588454784 00000100:00100000:1.0:1787432652.591733:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588454784 00000100:00100000:1.0:1787432652.591801:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588455040 00000100:00100000:1.0:1787432652.591804:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588455040 00000100:00100000:1.0:1787432652.591817:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588454912 00000100:00100000:1.0:1787432652.591819:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588454912 00000100:00100000:1.0:1787432652.591833:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:1.0:1787432652.591842:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a40dc378-0ae8-4eb1-a992-02a683490593+12:2401:x1874258588454784:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432652.591866:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432652.591887:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303012e00/0xca72b3b33563ec61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c81 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432652.591905:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432652.591957:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a40dc378-0ae8-4eb1-a992-02a683490593+11:2401:x1874258588454784:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 115us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432652.591965:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:1.0:1787432652.591983:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:1.0:1787432652.591990:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842eb4a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a40dc378-0ae8-4eb1-a992-02a683490593+10:2402:x1874258588455040:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432652.591997:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432652.592007:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94840149ea00/0xca72b3b33563ee59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4d3e expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432652.592018:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432652.592037:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842eb4a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a40dc378-0ae8-4eb1-a992-02a683490593+9:2402:x1874258588455040:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 48us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432652.592064:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:1.0:1787432652.592107:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:1.0:1787432652.592114:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a40dc378-0ae8-4eb1-a992-02a683490593+8:2401:x1874258588454912:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432652.592121:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432652.592131:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303013400/0xca72b3b33563ec68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4cb2 expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432652.592140:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432652.592157:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a40dc378-0ae8-4eb1-a992-02a683490593+7:2401:x1874258588454912:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 44us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432652.592211:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:3.0:1787432652.604409:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432652.604601:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588455296 00000100:00100000:0.0:1787432652.604612:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588455296 00000100:00100000:0.0:1787432652.604698:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 260 00000100:00100000:0.0:1787432652.604709:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+6:2399:x1874258588455296:12345-192.168.204.24@tcp:39:umount.0 00000020:00000080:0.0:1787432652.604749:0:6515:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ec76 00000020:00010000:0.0:1787432652.604759:0:6515:0:(genops.c:1921:obd_stale_export_put()) Put export ffff94843f837800: total 0 00000100:00080000:0.0:1787432652.604764:0:6515:0:(import.c:65:import_set_state_nolock()) ffff94843f833800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1787432652.604926:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:0.0:1787432652.605868:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00010000:1.0:1787432652.606478:0:6501:0:(genops.c:1907:obd_stale_export_get()) Get export ffff94843f837800: total 0 00010000:00010000:1.0:1787432652.606485:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432652.606566:0:6501:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94843f837800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787432652.606604:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9483032ad500) 00010000:00010000:1.0:1787432652.606609:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432652.606619:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488e00/0xca72b3b33563fc36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5119 expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432652.606650:0:6501:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94843f837800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787432652.606665:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432652.606666:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432652.606668:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432652.606945:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+3:2399:x1874258588455296:12345-192.168.204.24@tcp:39:umount.0 Request processed in 2234us (2542us total) trans 4294967529 rc 0/0 00000100:00100000:0.0:1787432652.606957:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 260 00000100:00100000:3.0:1787432652.618630:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432652.618862:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588455424 00000100:00100000:1.0:1787432652.618873:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588455424 00000100:00100000:1.0:1787432652.618972:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 261 00000100:00100000:1.0:1787432652.618998:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+5:2399:x1874258588455424:12345-192.168.204.24@tcp:39:umount.0 00000020:00000080:1.0:1787432652.619051:0:6513:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ec7d 00000100:00080000:1.0:1787432652.619060:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9483039eb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787432652.619092:0:6513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787432652.619299:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f5e99cc-19dc-4ba3-b74b-91816a9b078c+3:2399:x1874258588455424:12345-192.168.204.24@tcp:39:umount.0 Request processed in 303us (678us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787432652.619307:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 261 00000100:00080000:3.0:1787432652.619606:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787432652.620121:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432652.666064:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432652.666213:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588455680 00000100:00100000:1.0:1787432652.666224:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588455680 00000100:00100000:1.0:1787432652.666284:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 406 00000100:00100000:1.0:1787432652.666297:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+7:2399:x1874258588455680:12345-192.168.204.24@tcp:251:umount.0 00000020:00000080:1.0:1787432652.666345:0:6507:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563eb3b 00000020:00010000:1.0:1787432652.666354:0:6507:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9483036ed800: total 0 00000100:00080000:1.0:1787432652.666359:0:6507:0:(import.c:65:import_set_state_nolock()) ffff9483036ec800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787432652.666448:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a40dc378-0ae8-4eb1-a992-02a683490593+3:2399:x1874258588455680:12345-192.168.204.24@tcp:251:umount.0 Request processed in 153us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432652.666456:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 406 00000020:00010000:2.0:1787432652.666915:0:9519:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9483036ed800: total 0 00010000:00010000:2.0:1787432652.666972:0:9519:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9483036ed800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787432652.667006:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948401683c00/0xca72b3b33563ec14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d4c73 expref: 2 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432652.667021:0:9519:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9483036ed800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787432652.667030:0:9519:0:(genops.c:885:class_export_put()) final put ffff9483036ed800/a40dc378-0ae8-4eb1-a992-02a683490593 00010000:00010000:2.0:1787432652.667049:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432652.667052:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432652.667053:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787432652.667226:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9483036ed800/a40dc378-0ae8-4eb1-a992-02a683490593 for MGS 00000020:00000080:1.0:1787432652.667262:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9483036ec800 for MGS 00000100:00100000:2.0:1787432652.747387:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432652.747408:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609469184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432652.747599:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432652.747710:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609469184 00000100:00100000:0.0:1787432652.747719:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609469184 00000100:00100000:0.0:1787432652.747767:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787432652.747777:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609469184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432652.747822:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787432652.747891:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609469184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432652.747899:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787432652.748155:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609469184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432652.748536:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609469440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432652.748572:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432652.748647:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609469440 00000100:00100000:2.0:1787432652.748652:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609469440 00000100:00100000:2.0:1787432652.748692:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787432652.748700:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609469440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432652.748719:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432652.748781:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432652.748792:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609469312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432652.748822:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787432652.748854:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432652.748854:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609469312 00000100:00100000:1.0:1787432652.748858:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609469312 00000100:00100000:1.0:1787432652.748900:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787432652.748907:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609469312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787432652.748928:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787432652.748967:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609469312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (144us total) trans 0 rc 0/0 00000100:00080000:3.0:1787432652.748972:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432652.748974:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787432652.749007:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609469312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432652.755864:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609469440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432652.755935:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609469440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7233us (7359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432652.755947:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00010000:00010000:1.0:1787432653.004234:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432653.260415:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609469696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432653.260474:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432653.260546:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609469696 00000100:00100000:1.0:1787432653.260553:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609469696 00000100:00100000:1.0:1787432653.260601:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787432653.260612:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609469696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787432653.260639:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787432653.260682:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609469696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432653.260689:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:1.0:1787432653.260708:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432653.260737:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609469696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432653.260854:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609469824:0@lo:400:kworker.0 00000100:00100000:1.0:1787432653.260882:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432653.260904:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609470336:0@lo:400:kworker.0 00000100:00100000:1.0:1787432653.260926:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432653.260942:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609470848:0@lo:400:kworker.0 00000100:00100000:1.0:1787432653.260961:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432653.260977:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787432653.260981:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609470208:0@lo:400:kworker.0 00000100:00100000:1.0:1787432653.261012:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432653.261028:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609470720:0@lo:400:kworker.0 00000100:00100000:1.0:1787432653.261048:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432653.261064:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609471232:0@lo:400:kworker.0 00000100:00100000:1.0:1787432653.261081:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432653.261105:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609469824 00000100:00100000:1.0:1787432653.261108:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609469824 00000100:00100000:1.0:1787432653.261135:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1787432653.261142:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3642:x1874258609469824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432653.261293:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3642:x1874258609469824:12345-0@lo:400:kworker.0 Request processed in 151us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432653.261300:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1787432653.261327:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609470336 00000100:00100000:1.0:1787432653.261331:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609470336 00000100:00100000:1.0:1787432653.261354:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787432653.261361:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609470336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432653.261392:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609470336:12345-0@lo:400:kworker.0 Request processed in 32us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432653.261398:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000040:00080000:2.0:1787432653.261405:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787432653.261414:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609470848 00000100:00100000:1.0:1787432653.261417:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609470848 00000100:00100000:1.0:1787432653.261438:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609470720 00000100:00100000:1.0:1787432653.261440:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609470720 00000100:00100000:1.0:1787432653.261450:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609471232 00000100:00100000:1.0:1787432653.261452:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609471232 00000100:00100000:2.0:1787432653.261465:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609469568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787432653.261468:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787432653.261474:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609470848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432653.261522:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609470848:12345-0@lo:400:kworker.0 Request processed in 38us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432653.261528:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787432653.261541:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787432653.261547:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609470720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432653.261573:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609470720:12345-0@lo:400:kworker.0 Request processed in 27us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432653.261578:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787432653.261589:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787432653.261595:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609471232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432653.261619:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609471232:12345-0@lo:400:kworker.0 Request processed in 25us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432653.261624:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787432653.261641:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609470208 00000100:00100000:1.0:1787432653.261645:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609470208 00000100:00100000:1.0:1787432653.261669:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1787432653.261676:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609470208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432653.261703:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609470208:12345-0@lo:400:kworker.0 Request processed in 28us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432653.261709:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00080000:1.0:1787432653.261739:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432653.261761:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609470208:0@lo:400:kworker.0 00000100:00100000:1.0:1787432653.261772:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609470720:0@lo:400:kworker.0 00000100:00100000:1.0:1787432653.261781:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609471232:0@lo:400:kworker.0 00000100:00100000:1.0:1787432653.261799:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609469824:0@lo:400:kworker.0 00000100:00100000:2.0:1787432653.261803:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432653.261807:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609470336:0@lo:400:kworker.0 00000100:00100000:1.0:1787432653.261814:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609470848:0@lo:400:kworker.0 00000100:00100000:2.0:1787432653.261823:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609470080:0@lo:400:kworker.0 00000100:00100000:2.0:1787432653.261845:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432653.261861:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609470592:0@lo:400:kworker.0 00000100:00100000:2.0:1787432653.261901:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432653.261924:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609471104:0@lo:400:kworker.0 00000100:00100000:2.0:1787432653.261941:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432653.261959:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787432653.261964:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609469952:0@lo:400:kworker.0 00000100:00100000:2.0:1787432653.261982:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432653.261995:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609470464:0@lo:400:kworker.0 00000100:00100000:2.0:1787432653.262011:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432653.262024:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609470976:0@lo:400:kworker.0 00000100:00100000:2.0:1787432653.262038:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432653.262058:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609469568 00000100:00100000:2.0:1787432653.262061:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609469568 00000100:00100000:2.0:1787432653.262087:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787432653.262093:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609469568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787432653.262105:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787432653.262127:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609470592 00000100:00100000:1.0:1787432653.262131:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609470592 00000100:00100000:2.0:1787432653.262137:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609469568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432653.262143:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787432653.262152:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609471104 00000100:00100000:1.0:1787432653.262155:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609471104 00000100:00100000:2.0:1787432653.262158:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609470080 00000100:00100000:2.0:1787432653.262161:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609470080 00000100:00100000:1.0:1787432653.262184:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609469952 00000100:00100000:1.0:1787432653.262187:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609469952 00000100:00100000:2.0:1787432653.262199:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787432653.262205:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609470080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432653.262247:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609470080:12345-0@lo:400:kworker.0 Request processed in 43us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432653.262253:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787432653.262269:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609470464 00000100:00100000:2.0:1787432653.262278:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609470464 00000100:00100000:2.0:1787432653.262295:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609470976 00000100:00100000:2.0:1787432653.262298:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609470976 00000100:00100000:2.0:1787432653.262312:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1787432653.262317:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609470592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432653.262346:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609470592:12345-0@lo:400:kworker.0 Request processed in 29us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432653.262351:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1787432653.262361:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1787432653.262366:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609471104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432653.262390:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609471104:12345-0@lo:400:kworker.0 Request processed in 24us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432653.262394:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1787432653.262404:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1787432653.262409:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609470464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432653.262434:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874258609470464:12345-0@lo:400:kworker.0 Request processed in 25us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432653.262440:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1787432653.262450:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1787432653.262456:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609470976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432653.262775:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609470976:12345-0@lo:400:kworker.0 Request processed in 24us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432653.262783:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1787432653.263255:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609470464:0@lo:400:kworker.0 00000100:00100000:2.0:1787432653.263266:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609470976:0@lo:400:kworker.0 00000100:00100000:2.0:1787432653.263293:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609469568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432653.263304:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609470080:0@lo:400:kworker.0 00010000:00080000:2.0:1787432653.263316:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484359e9f80 x1874258609470592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432653.263326:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609470592:0@lo:400:kworker.0 00010000:00080000:2.0:1787432653.263336:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484359e9500 x1874258609471104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432653.263344:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609471104:0@lo:400:kworker.0 00000100:00100000:1.0:1787432653.263983:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1787432653.263997:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609469952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432653.264068:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609469952:12345-0@lo:400:kworker.0 Request processed in 75us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432653.264074:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00080000:1.0:1787432653.264093:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432653.264097:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432653.264120:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609469952:0@lo:400:kworker.0 00000040:00080000:3.0:1787432653.519492:0:13810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787432653.519501:0:13810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787432653.519604:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787432653.519611:0:13810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787432654.027444:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787432654.428371:0:15165:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787432654.440417:0:15165:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787432654.440471:0:15165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401682200/0xca72b3b33563ebe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.440484:0:15165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401682200/0xca72b3b33563ebe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ebea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.440503:0:15165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401682200/0xca72b3b33563ebe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ebea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.440511:0:15165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff948401682200/0xca72b3b33563ebe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ebea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.440535:0:15165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787432654.440541:0:15165:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1787432654.440542:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432654.440549:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948401682200/0xca72b3b33563ebe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ebea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432654.440557:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948401682200 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432654.440560:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948401682200/0xca72b3b33563ebe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ebea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432654.440569:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948401682200/0xca72b3b33563ebe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563ebea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432654.440576:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948401682200/0xca72b3b33563ebe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563ebea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787432654.440579:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:01000000:2.0:1787432654.440581:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787432654.440583:0:9519:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:0.0:1787432654.440583:0:15165:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 10000000:01000000:2.0:1787432654.440585:0:9519:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:0.0:1787432654.440588:0:15165:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787432654.440613:0:15165:0:(import.c:65:import_set_state_nolock()) ffff9484349de000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787432654.440616:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948401682200/0xca72b3b33563ebe3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563ebea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432654.440627:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787432654.440642:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874258609471488:0@lo:39:umount.0 00010000:00010000:2.0:1787432654.440650:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948401682200/0xca72b3b33563ebe3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563ebea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432654.440655:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948401682200/0xca72b3b33563ebe3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563ebea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432654.440666:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432654.440668:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432654.440669:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432654.440708:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432654.440746:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609471488 00000100:00100000:2.0:1787432654.440753:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609471488 00000100:00100000:2.0:1787432654.440790:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787432654.440800:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874258609471488:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787432654.440824:0:9020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e760 00000100:00080000:2.0:1787432654.440832:0:9020:0:(import.c:65:import_set_state_nolock()) ffff948434a8a000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787432654.440903:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3640:x1874258609471488:12345-0@lo:39:umount.0 Request processed in 104us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432654.440909:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:2.0:1787432654.440917:0:9020:0:(genops.c:885:class_export_put()) final put ffff948434a8c000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787432654.440944:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948434a8c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787432654.440984:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948434a8a000 for lustre-MDT0000 00000100:00080000:2.0:1787432654.441011:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484349de000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787432654.441019:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874258609471488:0@lo:39:umount.0 00010000:00010000:0.0:1787432654.441749:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787432654.441760:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787432654.441764:0:15165:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787432654.441768:0:15165:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787432654.442885:0:15165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303013a00/0xca72b3b33563ebf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebf8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.442899:0:15165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303013a00/0xca72b3b33563ebf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ebf8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.442906:0:15165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303013a00/0xca72b3b33563ebf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ebf8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.442912:0:15165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff948303013a00/0xca72b3b33563ebf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ebf8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.442934:0:15165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787432654.442939:0:15165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948400031000/0xca72b3b33563eaf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eafc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.442945:0:15165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948400031000/0xca72b3b33563eaf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563eafc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.442951:0:15165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948400031000/0xca72b3b33563eaf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563eafc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.442956:0:15165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff948400031000/0xca72b3b33563eaf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563eafc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.442982:0:15165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787432654.442989:0:15165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303851800/0xca72b3b33563ee4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ee52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.442995:0:15165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303851800/0xca72b3b33563ee4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ee52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.443001:0:15165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303851800/0xca72b3b33563ee4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ee52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.443007:0:15165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff948303851800/0xca72b3b33563ee4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ee52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.443019:0:15165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787432654.443033:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787432654.443039:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948303013a00/0xca72b3b33563ebf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ebf8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.443047:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303013a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1787432654.443050:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948303013a00/0xca72b3b33563ebf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ebf8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.443058:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948303013a00/0xca72b3b33563ebf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563ebf8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432654.443660:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787432654.443668:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948400031000/0xca72b3b33563eaf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563eafc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432654.443688:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948400031000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432654.443691:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948400031000/0xca72b3b33563eaf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563eafc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432654.443698:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948400031000/0xca72b3b33563eaf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563eafc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432654.443706:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948400031000/0xca72b3b33563eaf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563eafc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432654.443712:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787432654.443715:0:9519:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787432654.443717:0:9519:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787432654.443754:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948400031000/0xca72b3b33563eaf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563eafc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432654.443761:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432654.443785:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948400031000/0xca72b3b33563eaf5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563eafc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432654.443792:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948400031000/0xca72b3b33563eaf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563eafc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432654.443807:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432654.443810:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948303851800/0xca72b3b33563ee4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ee52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432654.443816:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851800 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432654.443818:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948303851800/0xca72b3b33563ee4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ee52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432654.443831:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948303851800/0xca72b3b33563ee4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563ee52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432654.443837:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948303851800/0xca72b3b33563ee4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563ee52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432654.443842:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787432654.443844:0:9519:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787432654.443846:0:9519:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787432654.443860:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948303851800/0xca72b3b33563ee4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563ee52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432654.443866:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432654.443873:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948303851800/0xca72b3b33563ee4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563ee52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432654.443879:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948303851800/0xca72b3b33563ee4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563ee52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432654.443887:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432654.443889:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432654.443890:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432654.443919:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609471616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432654.443978:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432654.444022:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432654.444028:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609471744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432654.444049:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1787432654.444248:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948303013a00/0xca72b3b33563ebf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563ebf8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432654.444255:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787432654.444263:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787432654.444278:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948303013a00/0xca72b3b33563ebf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563ebf8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.444285:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432654.444293:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948303013a00/0xca72b3b33563ebf1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563ebf8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.444299:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948303013a00/0xca72b3b33563ebf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563ebf8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.444309:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432654.444310:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432654.444313:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432654.444325:0:15165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4400/0xca72b3b33563e6b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e6b8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.444333:0:15165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4400/0xca72b3b33563e6b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e6b8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.444340:0:15165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4400/0xca72b3b33563e6b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563e6b8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.444347:0:15165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff9484032e4400/0xca72b3b33563e6b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563e6b8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.444361:0:15165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787432654.444365:0:15165:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787432654.444368:0:15165:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787432654.444400:0:15165:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787432654.444404:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787432654.444408:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787432654.444419:0:15165:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1787432654.444424:0:15165:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff948301dd0000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787432654.444430:0:15165:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff94843b952000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787432654.444435:0:15165:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff94843c7eb000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787432654.444440:0:15165:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff94843c60c000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1787432654.444447:0:15165:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff94843f837800 0f5e99cc-19dc-4ba3-b74b-91816a9b078c 192.168.204.24@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787432654.444452:0:15165:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff948303550800 e37f63ac-9665-4d30-ad26-0faad6e6c7da 192.168.204.24@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000020:00080000:0.0:1787432654.444457:0:15165:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff948433658000) has exports, disconnecting them 00000020:00080000:0.0:1787432654.444462:0:15165:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff948301dd0000), last request at 1787432653 00000020:00000080:0.0:1787432654.444468:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ea69 00000100:00080000:0.0:1787432654.444483:0:15165:0:(import.c:65:import_set_state_nolock()) ffff9483036ef800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787432654.444527:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432654.444532:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e4400/0xca72b3b33563e6b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563e6b8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.444538:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e4400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1787432654.444541:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4400/0xca72b3b33563e6b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563e6b8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.444548:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e4400/0xca72b3b33563e6b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563e6b8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432654.444553:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4400/0xca72b3b33563e6b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563e6b8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432654.444558:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787432654.444560:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787432654.444567:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787432654.444582:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484032e4400/0xca72b3b33563e6b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563e6b8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.444587:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432654.444593:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e4400/0xca72b3b33563e6b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563e6b8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.444600:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e4400/0xca72b3b33563e6b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563e6b8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432654.444608:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432654.444610:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432654.444611:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787432654.444625:0:15165:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff948301dd0000): rc 0 00000020:00000080:0.0:1787432654.444628:0:15165:0:(genops.c:885:class_export_put()) final put ffff948301dd0000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787432654.444639:0:15165:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94843b952000), last request at 1787432653 00000020:00000080:0.0:1787432654.444642:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e93c 00000100:00080000:0.0:1787432654.444647:0:15165:0:(import.c:65:import_set_state_nolock()) ffff94843b951800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787432654.444657:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787432654.444663:0:15165:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94843b952000): rc 0 00000020:00000080:0.0:1787432654.444665:0:15165:0:(genops.c:885:class_export_put()) final put ffff94843b952000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1787432654.444669:0:15165:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94843c7eb000), last request at 1787432396 00000020:00000080:0.0:1787432654.444672:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e839 00000100:00080000:0.0:1787432654.444676:0:15165:0:(import.c:65:import_set_state_nolock()) ffff94843c7eb800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787432654.444685:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787432654.444691:0:15165:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94843c7eb000): rc 0 00000020:00000080:0.0:1787432654.444693:0:15165:0:(genops.c:885:class_export_put()) final put ffff94843c7eb000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1787432654.444697:0:15165:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94843c60c000), last request at 1787432396 00000020:00000080:0.0:1787432654.444700:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e7fa 00000100:00080000:0.0:1787432654.444710:0:15165:0:(import.c:65:import_set_state_nolock()) ffff9484166d3800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787432654.444720:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787432654.444726:0:15165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:0.0:1787432654.444797:0:15165:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94843c60c000): rc 0 00000004:00000080:0.0:1787432654.444803:0:15165:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb0c1c0d1fae0 00000100:00080000:0.0:1787432654.444823:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787432654.444826:0:15165:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:1.0:1787432654.446796:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609471360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432654.446974:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609471616 00000100:00100000:2.0:1787432654.446983:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609471616 00000100:00100000:2.0:1787432654.447044:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609471744 00000100:00100000:2.0:1787432654.447048:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609471744 00000100:00100000:1.0:1787432654.447289:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787432654.447949:0:15165:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787432654.448007:0:15165:0:(import.c:65:import_set_state_nolock()) ffff948435a25000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787432654.448245:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432654.448264:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609471872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432654.448311:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432654.448433:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609472000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432654.448523:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609471360 00000100:00100000:2.0:1787432654.448530:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609471360 00000100:00100000:2.0:1787432654.448569:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787432654.448578:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0f84c3f-71b4-4eda-b290-0af337217d3a+26:3643:x1874258609471616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432654.448591:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787432654.448600:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787432654.448611:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+26:3643:x1874258609471744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432654.448612:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fd600/0xca72b3b33563eafc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563eaf5 expref: 26 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432654.448618:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432654.448627:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94840149fa00/0xca72b3b33563ee52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563ee4b expref: 25 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432654.448631:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432654.448636:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432654.448669:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3643:x1874258609471744:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (4618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432654.448675:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787432654.448691:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609471872 00000100:00100000:3.0:1787432654.448694:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609471872 00000100:00100000:3.0:1787432654.448712:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787432654.448717:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+24:3642:x1874258609471360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432654.448724:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432654.448732:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303013200/0xca72b3b33563ebea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563ebe3 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432654.448740:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432654.448760:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+23:3642:x1874258609471360:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432654.448766:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787432654.448776:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787432654.448782:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+22:3641:x1874258609471872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432654.448802:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432654.448811:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948401683a00/0xca72b3b33563ebf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563ebf1 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432654.448820:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432654.448844:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0f84c3f-71b4-4eda-b290-0af337217d3a+21:3641:x1874258609471872:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432654.448850:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787432654.448954:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609471872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432654.451459:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432654.451575:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:3643:x1874258609471616:12345-0@lo:103:ldlm_bl.0 Request processed in 2996us (7596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432654.451578:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609471744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432654.451588:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432654.451666:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609471616:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787432654.452116:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787432654.452120:0:15165:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1787432654.452216:0:15165:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787432654.452346:0:15165:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787432654.452441:0:15165:0:(import.c:65:import_set_state_nolock()) ffff948301dd7000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787432654.452454:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787432654.452457:0:15165:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1787432654.452469:0:15165:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787432654.452542:0:15165:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787432654.452551:0:15165:0:(import.c:65:import_set_state_nolock()) ffff9484359a4800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787432654.452581:0:15165:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff948433658000) has no exports 00000100:00100000:1.0:1787432654.452721:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609472000 00000100:00100000:1.0:1787432654.452728:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609472000 00000100:00100000:1.0:1787432654.452784:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787432654.452793:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+20:3642:x1874258609472000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432654.452824:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432654.452844:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fde00/0xca72b3b33563e6b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563e6b1 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432654.452862:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432654.452933:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609471360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432654.453088:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:3642:x1874258609472000:12345-0@lo:103:ldlm_bl.0 Request processed in 296us (1659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432654.453096:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000020:00000080:3.0:1787432654.453100:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dd0000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787432654.453507:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843b952000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787432654.453539:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843c7eb000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00100000:1.0:1787432654.453542:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609472128:0@lo:39:umount.0 00000020:00000080:3.0:1787432654.453559:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9483036ef800 for lustre-MDT0000 00000020:00000080:3.0:1787432654.453570:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94843b951800 for lustre-MDT0000 00000020:00000080:3.0:1787432654.453574:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94843c7eb800 for lustre-MDT0000 00000100:00100000:1.0:1787432654.453578:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787432654.453584:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432654.453600:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609472256:0@lo:9:umount.0 00000100:00100000:1.0:1787432654.453622:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432654.453651:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609472384:0@lo:9:umount.0 00000100:00100000:1.0:1787432654.453670:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432654.453696:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609472128 00000100:00100000:1.0:1787432654.453699:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609472128 00000100:00100000:1.0:1787432654.453727:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787432654.453733:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874258609472128:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787432654.453755:0:6518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e89b 00000100:00080000:1.0:1787432654.453762:0:6518:0:(import.c:65:import_set_state_nolock()) ffff948435aeb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787432654.453782:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787432654.453904:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3640:x1874258609472128:12345-0@lo:39:umount.0 Request processed in 171us (325us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787432654.453912:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787432654.453930:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609472256 00000100:00100000:1.0:1787432654.453933:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609472256 00000100:00100000:1.0:1787432654.453960:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609472384 00000100:00100000:1.0:1787432654.453970:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609472384 00000100:00100000:1.0:1787432654.453991:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787432654.453997:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874258609472256:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787432654.454250:0:8806:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e9f2 00000100:00080000:1.0:1787432654.454257:0:8806:0:(import.c:65:import_set_state_nolock()) ffff94843c7f1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787432654.454295:0:8806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787432654.454370:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3640:x1874258609472256:12345-0@lo:9:umount.0 Request processed in 373us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432654.454377:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787432654.454389:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787432654.454395:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874258609472384:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787432654.454406:0:8806:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563eb2d 00000100:00080000:1.0:1787432654.454411:0:8806:0:(import.c:65:import_set_state_nolock()) ffff9483032fa800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787432654.454434:0:8806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1787432654.454509:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3640:x1874258609472384:12345-0@lo:9:umount.0 Request processed in 114us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432654.454515:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:1.0:1787432654.454537:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787432654.454544:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787432654.454594:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432654.454607:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787432654.454645:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948435a25000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787432654.454652:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609472128:0@lo:39:umount.0 00000100:00080000:1.0:1787432654.454664:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948301dd7000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787432654.454694:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787432654.454696:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787432654.454699:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609472256:0@lo:9:umount.0 00000100:00080000:1.0:1787432654.454808:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484359a4800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787432654.454822:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787432654.454831:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787432654.454835:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609472384:0@lo:9:umount.0 00000100:00100000:0.0:1787432654.455039:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609472000:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787432654.460548:0:15165:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff948433658000) has no exports 00000020:00000080:0.0:1787432654.532293:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e70c 00000020:00000080:0.0:1787432654.532311:0:15165:0:(genops.c:885:class_export_put()) final put ffff9484348a6800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787432654.532333:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787432654.532394:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9484348a6800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787432654.532421:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432654.532431:0:15165:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787432654.532436:0:15165:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff94843361b370) has no exports 00000020:00000080:1.0:1787432654.533043:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e705 00000020:00000080:1.0:1787432654.533049:0:15165:0:(genops.c:885:class_export_put()) final put ffff948434880800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787432654.533109:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432654.533114:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948434880800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787432654.533116:0:15165:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787432654.533119:0:15165:0:(genops.c:885:class_export_put()) final put ffff948418d86800/lustre-QMT0000_UUID 00000020:00000080:1.0:1787432654.533121:0:15165:0:(genops.c:844:class_export_destroy()) destroying export ffff948418d86800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787432654.533138:0:15165:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1787432655.051387:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432656.077119:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787432656.865340:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787432656.865359:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1787432656.865364:0:7445:0:(genops.c:885:class_export_put()) final put ffff9484059b6000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787432656.865395:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0f5e99cc-19dc-4ba3-b74b-91816a9b078c 00000001:00080000:2.0:1787432656.865401:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1787432656.865403:0:7445:0:(genops.c:885:class_export_put()) final put ffff9483039e8800/0f5e99cc-19dc-4ba3-b74b-91816a9b078c 00000001:00100000:2.0:1787432656.865408:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000001:00080000:2.0:1787432656.865413:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1787432656.865415:0:7445:0:(genops.c:885:class_export_put()) final put ffff948303556000/e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000020:00000080:0.0:1787432656.865500:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9484059b6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1787432656.865570:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9483039e8800/0f5e99cc-19dc-4ba3-b74b-91816a9b078c for lustre-MDT0001 00000020:00000080:0.0:1787432656.865594:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948303556000/e37f63ac-9665-4d30-ad26-0faad6e6c7da for lustre-MDT0001 00000020:00000080:0.0:1787432656.865621:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948435aeb800 for lustre-MDT0001 00000020:00000080:0.0:1787432656.865626:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9483039eb800 for lustre-MDT0001 00000020:00000080:0.0:1787432656.865630:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948303556800 for lustre-MDT0001 00000001:00100000:3.0:1787432656.873651:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787432656.873672:0:8425:0:(genops.c:885:class_export_put()) final put ffff9484166d0800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787432656.873791:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000020:00000080:3.0:1787432656.873795:0:8425:0:(genops.c:885:class_export_put()) final put ffff948416482000/e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000020:00000080:2.0:1787432656.890905:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9484166d0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787432656.891014:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94843c7f1000 for lustre-OST0000 00000001:00100000:2.0:1787432656.894521:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787432656.894530:0:9509:0:(genops.c:885:class_export_put()) final put ffff9483032fd800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787432656.894562:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000020:00000080:2.0:1787432656.894565:0:9509:0:(genops.c:885:class_export_put()) final put ffff9483025b3800/e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000020:00000080:0.0:1787432656.894959:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9483032fd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787432656.895011:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9483025b3800/e37f63ac-9665-4d30-ad26-0faad6e6c7da for lustre-OST0001 00000020:00000080:0.0:1787432656.895048:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948416482000/e37f63ac-9665-4d30-ad26-0faad6e6c7da for lustre-OST0000 00000020:00000080:0.0:1787432656.895066:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9483032fa800 for lustre-OST0001 00000020:00000080:0.0:1787432656.895071:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9483025b4800 for lustre-OST0001 00000020:00000080:0.0:1787432656.895074:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948416487000 for lustre-OST0000 00000001:00100000:0.0:1787432656.896311:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787432656.896329:0:6492:0:(genops.c:885:class_export_put()) final put ffff94843c60c000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787432656.896355:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0f5e99cc-19dc-4ba3-b74b-91816a9b078c 00000001:00080000:0.0:1787432656.896362:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:0.0:1787432656.896368:0:6492:0:(genops.c:885:class_export_put()) final put ffff94843f837800/0f5e99cc-19dc-4ba3-b74b-91816a9b078c 00000001:00100000:0.0:1787432656.896373:0:6492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000001:00080000:0.0:1787432656.896376:0:6492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1787432656.896385:0:6492:0:(genops.c:885:class_export_put()) final put ffff948303550800/e37f63ac-9665-4d30-ad26-0faad6e6c7da 00000020:00000080:2.0:1787432656.896607:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94843c60c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1787432656.896712:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94843f837800/0f5e99cc-19dc-4ba3-b74b-91816a9b078c for lustre-MDT0000 00000020:00000080:2.0:1787432656.896759:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff948303550800/e37f63ac-9665-4d30-ad26-0faad6e6c7da for lustre-MDT0000 00000020:00000080:2.0:1787432656.896825:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9484166d3800 for lustre-MDT0000 00000020:00000080:2.0:1787432656.896830:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94843f833800 for lustre-MDT0000 00000020:00000080:2.0:1787432656.896834:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948303552000 for lustre-MDT0000 00010000:00010000:2.0:1787432657.101026:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432657.867917:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432657.867945:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609472512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432657.868027:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432657.868242:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609472512 00000100:00100000:2.0:1787432657.868252:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609472512 00000100:00100000:2.0:1787432657.868299:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787432657.868308:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1874258609472512:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1787432657.868317:0:7824:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787432657.868354:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1874258609472512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (327us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787432657.868361:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787432657.868664:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609472640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432657.868698:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:02020000:1.0:1787432657.870417:0:3644:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:0.0:1787432657.876145:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609472640 00000100:00100000:0.0:1787432657.876161:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609472640 00000100:00100000:0.0:1787432657.876504:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787432657.876525:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609472640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787432657.876558:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432657.876636:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609472640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (7937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432657.876643:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1787432657.876723:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787432657.887867:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787432657.887876:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94843c609800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787432657.887881:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787432657.905925:0:3644:0:(import.c:65:import_set_state_nolock()) ffff94843c609800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787432657.905943:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 207 00000100:00080000:1.0:1787432657.905954:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff94843c609800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432657.906045:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9484359e8e00 x1874258609472768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787432657.906368:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609472640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432657.907233:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609472768:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787432657.907320:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432657.908394:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609472768 00000100:00100000:1.0:1787432657.908405:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609472768 00000100:00100000:1.0:1787432657.908460:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787432657.908469:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609472768:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1787432657.908488:0:6519:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787432657.919373:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609472768:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 10893us (12043us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787432657.919398:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:2.0:1787432657.919552:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c609800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787432657.919558:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787432657.919562:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609472768:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1787432658.123486:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787432658.379459:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787432658.379465:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787432658.379469:0:36:0:(import.c:65:import_set_state_nolock()) ffff94843c609800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432658.379477:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 468 00000100:00080000:0.0:1787432658.379494:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787432658.379500:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff94843c609800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432658.379509:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432658.379526:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609472896:0@lo:400:kworker.0 00000100:00100000:0.0:1787432658.379594:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432658.379669:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948303909880 x1874258609473024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787432658.379701:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609473152:0@lo:400:kworker.0 00000100:00100000:0.0:1787432658.379728:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432658.379760:0:10165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609473152 00000100:00100000:0.0:1787432658.379766:0:10165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609473152 00000100:00100000:2.0:1787432658.379768:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609473024:0@lo:38:kworker.0 00000100:00100000:2.0:1787432658.379799:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432658.379800:0:10165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787432658.379808:0:10165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1874258609473152:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787432658.379816:0:10165:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787432658.379833:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609473024 00000100:00100000:2.0:1787432658.379837:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609473024 00000100:00100000:0.0:1787432658.379853:0:10165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1874258609473152:12345-0@lo:400:kworker.0 Request processed in 44us (124us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787432658.379856:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787432658.379860:0:10165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787432658.379861:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1874258609473024:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1787432658.379877:0:7824:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1787432658.379895:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787432658.379899:0:3642:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787432658.379903:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1787432658.379905:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1874258609473024:12345-0@lo:38:kworker.0 Request processed in 43us (105us total) trans 0 rc -19/-19 00000100:00080000:0.0:1787432658.379907:0:3642:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1787432658.379910:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:0.0:1787432658.379911:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 207 00000100:00080000:0.0:1787432658.379914:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94843c7f3800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432658.379927:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94830390b100 x1874258609473408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432658.379934:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c609800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1787432658.380056:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432658.380123:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609472896 00000100:00100000:3.0:1787432658.380127:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609472896 00000100:00080000:2.0:1787432658.380806:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787432658.384686:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609473152:0@lo:400:kworker.0 00000100:00100000:0.0:1787432658.384905:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432658.384926:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609473664:0@lo:400:kworker.0 00000100:00100000:3.0:1787432658.385453:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:1.0:1787432658.385466:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609473280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432658.385476:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948412293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:3642:x1874258609472896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432658.385655:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609473024:0@lo:38:kworker.0 00000100:00100000:2.0:1787432658.385680:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874258609473408:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787432658.391796:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432658.391879:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609473664 00000100:00100000:1.0:1787432658.391888:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609473664 00000100:00100000:0.0:1787432658.391908:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609473792:0@lo:400:kworker.0 00000100:00100000:0.0:1787432658.391949:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432658.391955:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1787432658.391965:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609473664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432658.391999:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432658.392005:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609474176:0@lo:400:kworker.0 00000100:00100000:0.0:1787432658.392027:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787432658.392094:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787432658.392114:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432658.392145:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609473536:0@lo:400:kworker.0 00000100:00100000:0.0:1787432658.392189:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432658.392210:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609473536 00000100:00100000:0.0:1787432658.392214:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609473536 00000100:00100000:1.0:1787432658.392221:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609473664:12345-0@lo:400:kworker.0 Request processed in 258us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432658.392229:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1787432658.392235:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787432658.392240:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1874258609473536:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787432658.392246:0:6514:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787432658.392250:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609473792 00000100:00100000:1.0:1787432658.392253:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609473792 00000100:00100000:0.0:1787432658.392272:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1874258609473536:12345-0@lo:400:kworker.0 Request processed in 31us (82us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787432658.392273:0:8806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609474176 00000100:00100000:1.0:1787432658.392275:0:8806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609474176 00000100:00100000:0.0:1787432658.392279:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787432658.392297:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787432658.392304:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609473792:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787432658.392438:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787432658.392443:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9484166d2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787432658.392447:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787432658.396776:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609473792:12345-0@lo:400:kworker.0 Request processed in 4460us (4813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432658.396860:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787432658.396902:0:8806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787432658.396929:0:8806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609474176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432658.396982:0:8806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609474176:12345-0@lo:400:kworker.0 Request processed in 59us (4954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432658.396988:0:8806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1787432658.397124:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432658.397184:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609474176:0@lo:400:kworker.0 00000100:00100000:1.0:1787432658.397198:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609473792:0@lo:400:kworker.0 00010000:00080000:1.0:1787432658.397214:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830390a300 x1874258609473664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432658.397225:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609473664:0@lo:400:kworker.0 00000100:00100000:1.0:1787432658.397292:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609473920:0@lo:400:kworker.0 00000100:00100000:1.0:1787432658.397330:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432658.397371:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609473920 00000100:00100000:1.0:1787432658.397378:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609473920 00000100:00100000:1.0:1787432658.397428:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787432658.397434:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874258609473920:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787432658.397440:0:6513:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787432658.397474:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874258609473920:12345-0@lo:400:kworker.0 Request processed in 39us (143us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787432658.397481:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1787432658.397505:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787432658.397509:0:3643:0:(import.c:65:import_set_state_nolock()) ffff94843c7ed800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787432658.397514:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787432658.397519:0:3643:0:(import.c:65:import_set_state_nolock()) ffff94843c7ed800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787432658.397531:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 254 00000100:00080000:1.0:1787432658.397537:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94843c7ed800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432658.398020:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9484359e8000 x1874258609474304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787432658.398047:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609473920:0@lo:400:kworker.0 00000100:00100000:1.0:1787432658.398104:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609473280 00000100:00100000:1.0:1787432658.398109:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609473280 00000100:00100000:1.0:1787432658.398149:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787432658.398156:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609473280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787432658.398206:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787432658.398252:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609473280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (6137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432658.398258:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787432658.398470:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432658.398499:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874258609474304:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787432658.398610:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432658.398636:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609473408 00000100:00100000:2.0:1787432658.398639:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609473408 00000100:00100000:2.0:1787432658.398662:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609474304 00000100:00100000:2.0:1787432658.398664:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609474304 00000100:00100000:2.0:1787432658.398679:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787432658.398685:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874258609473408:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1787432658.398700:0:6514:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787432658.398730:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874258609473408:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 44us (261us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787432658.398737:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787432658.398803:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948412293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d0f84c3f-71b4-4eda-b290-0af337217d3a+19:3642:x1874258609472896:12345-0@lo:400:kworker.0 Request processed in 13337us (19208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432658.398812:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1787432658.398848:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0f84c3f-71b4-4eda-b290-0af337217d3a:3642:1874258609472896:0@lo:400:kworker.0 00000100:00100000:1.0:1787432658.401667:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787432658.401686:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874258609474304:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1787432658.401706:0:6515:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787432658.401866:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874258609474304:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 113us (3184us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787432658.401875:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1787432658.401982:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7ed800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432658.401988:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787432658.401992:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874258609474304:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1787432658.402006:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432658.402009:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787432658.402012:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874258609473408:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1787432658.402797:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9484166d2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432658.402814:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 230 00000100:00080000:0.0:1787432658.402823:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9484166d2800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432658.402861:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94830390b100 x1874258609474432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787432658.402893:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1874258609473536:0@lo:400:kworker.0 00000100:00100000:0.0:1787432658.402903:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609474048:0@lo:400:kworker.0 00000100:00100000:0.0:1787432658.402946:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432658.402980:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609474048 00000100:00100000:0.0:1787432658.402985:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609474048 00000100:00100000:0.0:1787432658.403035:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1787432658.403043:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609474048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432658.403090:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609474048:12345-0@lo:400:kworker.0 Request processed in 48us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432658.403098:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00080000:0.0:1787432658.403118:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787432658.403139:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303908380 x1874258609474048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432658.403151:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609474048:0@lo:400:kworker.0 00000100:00100000:0.0:1787432658.403273:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609473280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432658.403427:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874258609474432:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787432658.403456:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432658.403588:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609474432 00000100:00100000:0.0:1787432658.403592:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609474432 00000100:00100000:0.0:1787432658.403619:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787432658.403624:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874258609474432:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1787432658.403638:0:6513:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787432658.403669:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874258609474432:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 44us (212us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787432658.403681:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1787432658.403748:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484166d2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787432658.403752:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787432658.403755:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874258609474432:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:2.0:1787432659.148609:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432660.173070:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787432660.619745:0:15165:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94830269eea0 - data ffff94830204d360/ffff94843c80a400 00000020:01000000:1.0:1787432660.619875:0:15165:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948411a25b40 - data ffff94842e083870/ffff94843487cc00 00000001:00000004:1.0:1787432660.630988:0:15165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:0.0:1787432660.717750:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787432660.717759:0:15165:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1787432660.717773:0:15165:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff94830390a680 x1874258609472128/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787432664 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432660.717797:0:15165:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787432660.720558:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787432660.720566:0:15165:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1787432660.720619:0:15165:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787432660.720623:0:15165:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787432660.721348:0:8804:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787432660.721354:0:8804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1787432660.721375:0:8804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787432660.722002:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787432660.722007:0:15165:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1787432660.722025:0:15165:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787432660.722028:0:15165:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787432660.722516:0:9957:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787432660.722520:0:9957:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1787432660.722528:0:9957:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787432660.724145:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e6d4 00000020:00000080:1.0:1787432660.724158:0:15165:0:(genops.c:885:class_export_put()) final put ffff9484059b6800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787432660.725025:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff9484059b6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787432660.733053:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e6e9 00000020:00000080:0.0:1787432660.733068:0:15165:0:(genops.c:885:class_export_put()) final put ffff9484059b3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787432660.733078:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787432660.733083:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787432660.733092:0:15165:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787432660.733096:0:15165:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff94843365b370) has no exports 00000004:01000000:0.0:1787432660.733297:0:15165:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787432660.733304:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563eb1f 00000020:00000080:0.0:1787432660.733309:0:15165:0:(genops.c:885:class_export_put()) final put ffff948301dc7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787432660.733313:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787432660.733317:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787432660.733325:0:15165:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787432660.733328:0:15165:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9483030f3370) has no exports 00000020:00000080:0.0:1787432660.733336:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563eb18 00000020:00000080:0.0:1787432660.733339:0:15165:0:(genops.c:885:class_export_put()) final put ffff9484359a5000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787432660.733935:0:15165:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787432660.733949:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787432660.733953:0:15165:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1787432660.733959:0:15165:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787432660.733961:0:15165:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787432660.733993:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787432660.734002:0:15165:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787432660.734008:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e9dd 00000020:00000080:0.0:1787432660.734013:0:15165:0:(genops.c:885:class_export_put()) final put ffff948301dc2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787432660.734018:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787432660.734022:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787432660.734026:0:15165:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787432660.734028:0:15165:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9483030f0000) has no exports 00000020:00000080:0.0:1787432660.734032:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e9d6 00000020:00000080:0.0:1787432660.734034:0:15165:0:(genops.c:885:class_export_put()) final put ffff948301dd0800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787432660.734521:0:15165:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787432660.734525:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787432660.734527:0:15165:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1787432660.734531:0:15165:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787432660.734533:0:15165:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787432660.734560:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787432660.734567:0:15165:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1787432660.734577:0:15165:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787432660.734583:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e88d 00000020:00000080:0.0:1787432660.734587:0:15165:0:(genops.c:885:class_export_put()) final put ffff948434b72000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787432660.734591:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1787432660.734594:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787432660.734598:0:15165:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787432660.734601:0:15165:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9484093b19b8) has no exports 00000020:00000080:0.0:1787432660.734604:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e886 00000020:00000080:0.0:1787432660.734607:0:15165:0:(genops.c:885:class_export_put()) final put ffff948435a20000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787432660.737317:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff9484059b3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1787432660.737335:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dc7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787432660.737358:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff9484359a5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787432660.737374:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9484359a4800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787432660.737386:0:474:0:(genops.c:885:class_export_put()) final put ffff9483036e9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787432660.737388:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff9483036e9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787432660.737394:0:474:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787432660.737491:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dc2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787432660.737498:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dd0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787432660.737502:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948301dd7000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787432660.737507:0:474:0:(genops.c:885:class_export_put()) final put ffff948301e45800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787432660.737509:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff948301e45800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787432660.737512:0:474:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787432660.737542:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff948434b72000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787432660.737548:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff948435a20000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787432660.738567:0:15165:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1787432660.738574:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787432660.738579:0:15165:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1787432660.738588:0:15165:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787432660.738676:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432660.738691:0:15165:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787432660.738732:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432660.738736:0:15165:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787432660.738741:0:15165:0:(genops.c:885:class_export_put()) final put ffff9484166d6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787432660.738745:0:15165:0:(genops.c:844:class_export_destroy()) destroying export ffff9484166d6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787432660.738752:0:15165:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787432660.738844:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e6f0 00000020:00000080:1.0:1787432660.738852:0:15165:0:(genops.c:885:class_export_put()) final put ffff9484059b3000/lustre-MDD0000_UUID 00000020:01000000:1.0:1787432660.738857:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787432660.738861:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432660.738865:0:15165:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787432660.738869:0:15165:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff94843365cd28) has no exports 00000020:00000080:1.0:1787432660.738892:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432660.738896:0:15165:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787432660.738900:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e6f7 00000020:00000080:1.0:1787432660.738903:0:15165:0:(genops.c:885:class_export_put()) final put ffff9484059b7800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787432660.738912:0:15165:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948411b1c000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787432660.738925:0:15165:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948411b1c000 3 00000020:01000004:1.0:1787432660.738928:0:15165:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff948411b1c000 from lustre-MDT0000 00000020:00000080:1.0:1787432660.738947:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432660.738951:0:15165:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787432660.738954:0:15165:0:(genops.c:885:class_export_put()) final put ffff9484059b5000/lustre-MDT0000_UUID 00000020:00000080:1.0:1787432660.738956:0:15165:0:(genops.c:844:class_export_destroy()) destroying export ffff9484059b5000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787432660.738964:0:15165:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787432660.738994:0:15165:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1787432660.738999:0:15165:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787432660.739002:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787432660.739004:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432660.739007:0:15165:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787432660.739014:0:15165:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff94840615c800 d0f84c3f-71b4-4eda-b290-0af337217d3a 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787432660.739019:0:15165:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff94841de999b8) has exports, disconnecting them 00000020:00080000:1.0:1787432660.739023:0:15165:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff94840615c800), last request at 1787432376 00000020:00000080:1.0:1787432660.739037:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e695 00000020:00010000:1.0:1787432660.739041:0:15165:0:(genops.c:1921:obd_stale_export_put()) Put export ffff94840615c800: total 2 00000100:00080000:1.0:1787432660.739045:0:15165:0:(import.c:65:import_set_state_nolock()) ffff9484106b1800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787432660.739059:0:15165:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94840615c800): rc 0 00000020:00080000:1.0:1787432660.739063:0:15165:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff94841de999b8) has no exports 00000020:00010000:1.0:1787432660.739082:0:6501:0:(genops.c:1907:obd_stale_export_get()) Get export ffff94840615c800: total 2 00010000:00010000:1.0:1787432660.739107:0:6501:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94840615c800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787432660.739136:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303013800/0xca72b3b33563ebb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563ebab expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432660.739155:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94843f85e000/0xca72b3b33563ebc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563ebb9 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432660.739187:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94843f85f600/0xca72b3b33563ebdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563ebd5 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432660.739211:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948401682600/0xca72b3b33563e791 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563e78a expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432660.739225:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948401683800/0xca72b3b33563ebce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563ebc7 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432660.739236:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948401682000/0xca72b3b33563e79f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563e798 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432660.739246:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303013000/0xca72b3b33563ee28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563ee21 expref: 8 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432660.739255:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303851200/0xca72b3b33563ee36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563ee2f expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432660.739266:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484013fcc00/0xca72b3b33563ec06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563ebff expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432660.739277:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948401682a00/0xca72b3b33563eb96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563eb8f expref: 5 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432660.739287:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94843f85f400/0xca72b3b33563ee44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563ee3d expref: 4 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432660.739298:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948401683200/0xca72b3b33563eba4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563eb9d expref: 3 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432660.739310:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948400031c00/0xca72b3b33563eab6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xca72b3b33563eaaf expref: 2 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432660.739335:0:6501:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94840615c800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1787432660.739349:0:6501:0:(genops.c:885:class_export_put()) final put ffff94840615c800/d0f84c3f-71b4-4eda-b290-0af337217d3a 00010000:00010000:1.0:1787432660.739354:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432660.739356:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432660.739358:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432660.739426:0:6507:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff948427ec0000:6507] 1 exiting: rc = 0 00000100:00100000:1.0:1787432660.739539:0:6506:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff948427ec0800:6506] 0 exiting: rc = 1 00000020:00000080:3.0:1787432660.742009:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948435a25000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787432660.742029:0:474:0:(genops.c:885:class_export_put()) final put ffff94843c60e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787432660.742032:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff94843c60e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1787432660.742040:0:474:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787432660.742128:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff9484059b3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787432660.742133:0:474:0:(genops.c:885:class_export_put()) final put ffff9484059b5800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787432660.742135:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff9484059b5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787432660.742139:0:474:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787432660.742180:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff9484059b7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787432660.742185:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff94840615c800/d0f84c3f-71b4-4eda-b290-0af337217d3a for MGS 00000020:00000080:3.0:1787432660.742222:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9484106b1800 for MGS 00000100:00100000:3.0:1787432660.742268:0:6508:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9484122e8e00:6508] 2 exiting: rc = 0 00000100:00100000:1.0:1787432660.743009:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743020:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743038:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743044:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743050:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743056:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743062:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743067:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743073:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743079:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743084:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743090:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743095:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743100:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743105:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743111:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743117:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743123:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743129:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743136:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743144:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743149:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743155:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743182:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743189:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743214:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743219:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743226:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743231:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743236:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743242:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743248:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743255:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743260:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743266:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743272:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743278:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743284:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743289:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743294:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743300:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743306:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743311:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743318:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743323:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743328:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743334:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743339:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743345:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743350:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743355:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743361:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743375:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743380:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743385:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743390:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743396:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743401:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743407:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743412:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743425:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743431:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743437:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432660.743442:0:15165:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1787432660.744874:0:15165:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94830384f3c0 - data ffff94842e2bb360/ffff94843f8ddc00 00000020:01000000:1.0:1787432660.744998:0:15165:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948411a25ea0 - data ffff94842e0ef5e8/ffff94841024f800 00000020:00000080:1.0:1787432660.745440:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e679 00000020:00000080:1.0:1787432660.745447:0:15165:0:(genops.c:885:class_export_put()) final put ffff9484034a5800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787432660.745462:0:15165:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948411b1c000 from MGS, refs=2 00000020:01000004:1.0:1787432660.745465:0:15165:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948411b1c000 2 00000020:01000004:1.0:1787432660.745468:0:15165:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff948411b1c000 from MGS 00000020:00000080:1.0:1787432660.745490:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432660.745497:0:15165:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787432660.745500:0:15165:0:(genops.c:885:class_export_put()) final put ffff9484034a6800/MGS 00000020:00000080:1.0:1787432660.745502:0:15165:0:(genops.c:844:class_export_destroy()) destroying export ffff9484034a6800/MGS for MGS 00000020:01000000:1.0:1787432660.745508:0:15165:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787432660.745567:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787432660.745570:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432660.745575:0:15165:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787432660.745581:0:15165:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9484349de800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787432660.745587:0:15165:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9484349d0000) has exports, disconnecting them 00000020:00080000:1.0:1787432660.745592:0:15165:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9484349de800), last request at 1787432376 00000020:00000080:1.0:1787432660.745596:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e744 00000020:00080000:1.0:1787432660.745604:0:15165:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9484349de800): rc 0 00000020:00000080:1.0:1787432660.745608:0:15165:0:(genops.c:885:class_export_put()) final put ffff9484349de800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787432660.746256:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9484034a5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787432660.746269:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9484349de800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787432660.807259:0:15165:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787432660.807269:0:15165:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787432660.807285:0:15165:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787432660.807292:0:15165:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787432660.807495:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787432660.807504:0:15165:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787432660.807511:0:15165:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948411b1c000 1 00000020:00000080:0.0:1787432660.807518:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e66b 00000020:00000080:0.0:1787432660.807528:0:15165:0:(genops.c:885:class_export_put()) final put ffff9484034a1800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787432660.807533:0:15165:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787432660.807538:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787432660.807541:0:15165:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787432660.807545:0:15165:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9484093b0000) has no exports 00000020:00000080:3.0:1787432660.807810:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9484349de000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787432660.807818:0:36:0:(genops.c:885:class_export_put()) final put ffff9484059b2000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787432660.807821:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9484059b2000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787432660.807832:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787432660.807905:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9484034a1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787432660.911208:0:15165:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787432660.911223:0:15165:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787432660.911229:0:15165:0:(genops.c:885:class_export_put()) final put ffff948411b1a800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787432660.911234:0:15165:0:(genops.c:844:class_export_destroy()) destroying export ffff948411b1a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787432660.911241:0:15165:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787432660.911369:0:15165:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff948411b18000 00000020:02000400:0.0:1787432660.911936:0:15165:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787432661.196636:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432662.220455:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432662.987639:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432662.990540:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609474560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432662.990624:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432662.993488:0:12227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609474560 00000100:00100000:0.0:1787432662.993504:0:12227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609474560 00000100:00100000:0.0:1787432662.993709:0:12227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787432662.993721:0:12227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609474560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787432662.993755:0:12227:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787432662.994031:0:12227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609474560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 311us (3405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432662.994039:0:12227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787432662.994370:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609474560:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787432662.994436:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787432663.250906:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432663.500783:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609474688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432663.500868:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432663.501063:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609474816:0@lo:400:kworker.0 00000400:00000100:2.0:1787432663.501093:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874258609474816 offset 0 length 224: 4 00000040:00080000:2.0:1787432663.504003:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787432663.504933:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609474688 00000100:00100000:0.0:1787432663.504945:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609474688 00000100:00100000:0.0:1787432663.505083:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787432663.505094:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609474688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787432663.505126:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787432663.505226:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609474688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (4358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432663.505234:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787432663.505300:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609474688:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787432663.513875:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787432663.513907:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787432663.513911:0:36:0:(import.c:65:import_set_state_nolock()) ffff94843c609800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787432663.513921:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 469 00000100:00080000:1.0:1787432663.513928:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787432663.513935:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff94843c609800 using connection 192.168.204.124@tcp/0@lo 00000100:00080000:2.0:1787432663.517867:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432663.518903:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948303908700 x1874258609474944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432663.518930:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787432663.518935:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787432663.518938:0:36:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432663.518952:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 469 00000100:00080000:0.0:1787432663.518957:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787432663.518964:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94843c7f3800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432663.518977:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948303909c00 x1874258609475072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432663.518986:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787432663.518988:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787432663.518990:0:36:0:(import.c:65:import_set_state_nolock()) ffff9484166d2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432663.518993:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 469 00000100:00080000:0.0:1787432663.518996:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787432663.518999:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9484166d2800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432663.519019:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94830390a300 x1874258609475200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432663.519064:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787432663.519067:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787432663.519069:0:36:0:(import.c:65:import_set_state_nolock()) ffff94843c7ed800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432663.519073:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 469 00000100:00080000:0.0:1787432663.519076:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787432663.519079:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94843c7ed800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432663.519093:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609475328:0@lo:400:kworker.0 00000100:00100000:2.0:1787432663.519150:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609474944:0@lo:38:kworker.0 00000100:00100000:0.0:1787432663.519186:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432663.519214:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432663.519242:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874258609475072:0@lo:38:kworker.0 00000100:00100000:0.0:1787432663.519251:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609475328 00000100:00100000:0.0:1787432663.519258:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609475328 00000100:00100000:2.0:1787432663.519285:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432663.519318:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874258609475200:0@lo:38:kworker.0 00000100:00100000:0.0:1787432663.519324:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609475072 00000100:00100000:0.0:1787432663.519329:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609475072 00000100:00100000:2.0:1787432663.519344:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432663.519494:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609475200 00000100:00100000:0.0:1787432663.519499:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609475200 00000100:00100000:0.0:1787432663.519519:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1787432663.519529:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609475328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432663.519591:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609475328:12345-0@lo:400:kworker.0 Request processed in 63us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432663.519599:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1787432663.519619:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787432663.519623:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1874258609475072:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787432663.519639:0:9020:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787432663.519670:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1874258609475072:12345-0@lo:38:kworker.0 Request processed in 46us (386us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787432663.519676:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787432663.519697:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787432663.519701:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1874258609475200:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787432663.519853:0:9020:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787432663.519883:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1874258609475200:12345-0@lo:38:kworker.0 Request processed in 180us (540us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787432663.519890:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787432663.519910:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609474944 00000100:00100000:0.0:1787432663.519914:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609474944 00000100:00100000:0.0:1787432663.519931:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787432663.519936:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609474944:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787432663.520037:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff948303908000 x1874258609475328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432663.520050:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609475328:0@lo:400:kworker.0 00010000:00020000:0.0:1787432663.520135:0:6519:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787432663.520195:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609474944:12345-0@lo:38:kworker.0 Request processed in 257us (982us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787432663.520201:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:0.0:1787432663.520229:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787432663.520250:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c609800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432663.520254:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787432663.520257:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609474944:0@lo:38:kworker.0 00000100:00080000:0.0:1787432663.520267:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432663.520270:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787432663.520273:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874258609475072:0@lo:38:kworker.0 00000100:00080000:0.0:1787432663.520281:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484166d2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432663.520284:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787432663.520287:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874258609475200:0@lo:38:kworker.0 00000100:00100000:0.0:1787432663.520331:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94830390a300 x1874258609475456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787432663.520386:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609475584:0@lo:400:kworker.0 00000100:00100000:0.0:1787432663.520413:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432663.520442:0:9020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609475584 00000100:00100000:0.0:1787432663.520446:0:9020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609475584 00000100:00100000:0.0:1787432663.520478:0:9020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1787432663.520485:0:9020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609475584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432663.520533:0:9020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609475584:12345-0@lo:400:kworker.0 Request processed in 49us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432663.520540:0:9020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00010000:00080000:0.0:1787432663.520567:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff948303909c00 x1874258609475584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432663.520578:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609475584:0@lo:400:kworker.0 00000100:00080000:0.0:1787432663.520592:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787432663.521850:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874258609475456:0@lo:38:kworker.0 00000100:00100000:1.0:1787432663.521907:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432663.522280:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609475456 00000100:00100000:1.0:1787432663.522289:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609475456 00000100:00100000:1.0:1787432663.522334:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787432663.522341:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874258609475456:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787432663.522361:0:6514:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787432663.522421:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874258609475456:12345-0@lo:38:kworker.0 Request processed in 78us (512us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787432663.522428:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:1.0:1787432663.522470:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7ed800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432663.522475:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787432663.522478:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874258609475456:0@lo:38:kworker.0 00010000:00010000:2.0:1787432664.275747:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432665.291785:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787432665.447814:0:15366:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787432665.464308:0:15366:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1787432665.464368:0:15366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33563ebc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.464385:0:15366:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33563ebc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ebce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.464393:0:15366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33563ebc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ebce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.464401:0:15366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33563ebc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ebce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.464431:0:15366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787432665.464438:0:15366:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787432665.464467:0:15366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787432665.464473:0:15366:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787432665.464479:0:15366:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787432665.464585:0:15366:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787432665.464592:0:15366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787432665.464595:0:15366:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787432665.464599:0:15366:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787432665.464958:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432665.464968:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33563ebc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ebce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432665.464978:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85f000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1787432665.464983:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33563ebc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ebce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432665.464993:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33563ebc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563ebce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432665.465000:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33563ebc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563ebce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432665.465014:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787432665.465017:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787432665.465019:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787432665.465058:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33563ebc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563ebce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432665.465066:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432665.465206:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33563ebc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563ebce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432665.465214:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff94843f85f000/0xca72b3b33563ebc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563ebce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432665.465237:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432665.465240:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432665.465242:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432665.465364:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609475712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432665.465434:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432665.465551:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609475712 00000100:00100000:0.0:1787432665.465559:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609475712 00000100:00100000:0.0:1787432665.465605:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787432665.465613:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94842eb49450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1874258609475712:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787432665.465619:0:6499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787432665 with bad export cookie 14587919725282715285 00010000:00010000:3.0:1787432665.465635:0:15366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303012a00/0xca72b3b33563ebd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebdc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.465647:0:15366:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303012a00/0xca72b3b33563ebd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ebdc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.465656:0:15366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303012a00/0xca72b3b33563ebd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ebdc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.465664:0:15366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff948303012a00/0xca72b3b33563ebd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ebdc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.465679:0:15366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432665.465686:0:15366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563eaaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eab6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.465692:0:15366:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563eaaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563eab6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.465699:0:15366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563eaaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563eab6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.465706:0:15366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563eaaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563eab6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.465721:0:15366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787432665.465728:0:15366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303850c00/0xca72b3b33563ee3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ee44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.465735:0:15366:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303850c00/0xca72b3b33563ee3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ee44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.465750:0:15366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303850c00/0xca72b3b33563ee3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ee44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.465757:0:15366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff948303850c00/0xca72b3b33563ee3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ee44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.465769:0:15366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787432665.465775:0:15366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5e00/0xca72b3b33563e798 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563e79f expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.465782:0:15366:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5e00/0xca72b3b33563e798 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563e79f expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.465790:0:15366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5e00/0xca72b3b33563e798 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563e79f expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.465796:0:15366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff9484032e5e00/0xca72b3b33563e798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563e79f expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432665.465804:0:15366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1787432665.465807:0:15366:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1787432665.465837:0:15366:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1787432665.465841:0:15366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1787432665.465845:0:15366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787432665.465851:0:15366:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1787432665.465857:0:15366:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9483032f9800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787432665.465863:0:15366:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff948301dc4000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787432665.465869:0:15366:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff94841de9cd28) has exports, disconnecting them 00000020:00080000:3.0:1787432665.465883:0:15366:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9483032f9800), last request at 1787432663 00000020:00000080:3.0:1787432665.465891:0:15366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ea77 00000100:00080000:3.0:1787432665.465909:0:15366:0:(import.c:65:import_set_state_nolock()) ffff9483032f9000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787432665.465962:0:15366:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9483032f9800): rc 0 00000020:00000080:3.0:1787432665.465965:0:15366:0:(genops.c:885:class_export_put()) final put ffff9483032f9800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1787432665.465984:0:15366:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff948301dc4000), last request at 1787432663 00000020:00000080:3.0:1787432665.465988:0:15366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e951 00000020:00000080:1.0:1787432665.465994:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff9483032f9800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00080000:3.0:1787432665.465995:0:15366:0:(import.c:65:import_set_state_nolock()) ffff948301dc6000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787432665.466008:0:15366:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff948301dc4000): rc 0 00000020:00000080:3.0:1787432665.466010:0:15366:0:(genops.c:885:class_export_put()) final put ffff948301dc4000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1787432665.466020:0:15366:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb0c1c16b7ae0 00000100:00080000:3.0:1787432665.466040:0:15366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000020:00000080:1.0:1787432665.466047:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9483032f9000 for lustre-MDT0001 00000100:00100000:3.0:1787432665.466049:0:15366:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff948304568a80 x1874258609472512/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787432673 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000080:1.0:1787432665.466054:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dc4000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00100000:3.0:1787432665.466068:0:15366:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000020:00000080:1.0:1787432665.466082:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948301dc6000 for lustre-MDT0001 00010000:00010000:2.0:1787432665.466334:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787432665.466342:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948303012a00/0xca72b3b33563ebd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ebdc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432665.466350:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303012a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432665.466354:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948303012a00/0xca72b3b33563ebd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ebdc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432665.466362:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948303012a00/0xca72b3b33563ebd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563ebdc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432665.466369:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948303012a00/0xca72b3b33563ebd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563ebdc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432665.466380:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:01000000:2.0:1787432665.466382:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787432665.466385:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1787432665.466385:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563eaaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563eab6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432665.466388:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:1.0:1787432665.466392:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e4e00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432665.466395:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563eaaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563eab6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432665.466402:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563eaaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563eab6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432665.466407:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563eaaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563eab6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432665.466412:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787432665.466414:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787432665.466416:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787432665.466422:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948303012a00/0xca72b3b33563ebd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563ebdc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432665.466428:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432665.466429:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563eaaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563eab6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432665.466434:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432665.466443:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948303012a00/0xca72b3b33563ebd5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563ebdc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432665.466449:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563eaaf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563eab6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432665.466450:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948303012a00/0xca72b3b33563ebd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563ebdc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432665.466456:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563eaaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563eab6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432665.466461:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787432665.466463:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948303850c00/0xca72b3b33563ee3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ee44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432665.466467:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432665.466469:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850c00 already unused, calling callback (ffffffffc122fc20) 00010000:00010000:1.0:1787432665.466470:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e5e00/0xca72b3b33563e798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563e79f expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432665.466471:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948303850c00/0xca72b3b33563ee3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ee44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432665.466477:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e5e00 already unused, calling callback (ffffffffc122fc20) 00010000:00010000:2.0:1787432665.466479:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948303850c00/0xca72b3b33563ee3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563ee44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432665.466485:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948303850c00/0xca72b3b33563ee3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563ee44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432665.466486:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e5e00/0xca72b3b33563e798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563e79f expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432665.466491:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787432665.466493:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e5e00/0xca72b3b33563e798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563e79f expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432665.466494:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787432665.466495:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:00010000:1.0:1787432665.466499:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e5e00/0xca72b3b33563e798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563e79f expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432665.466504:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787432665.466506:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787432665.466508:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787432665.466510:0:6502:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948303850c00/0xca72b3b33563ee3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563ee44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432665.466516:0:6502:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432665.466517:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484032e5e00/0xca72b3b33563e798 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563e79f expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432665.466522:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948303850c00/0xca72b3b33563ee3d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563ee44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432665.466522:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432665.466527:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e5e00/0xca72b3b33563e798 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563e79f expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432665.466528:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948303850c00/0xca72b3b33563ee3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563ee44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432665.466534:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e5e00/0xca72b3b33563e798 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xca72b3b33563e79f expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432665.466536:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432665.466538:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432665.466539:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432665.466543:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432665.466544:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432665.466546:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432665.466551:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432665.466553:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609475840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432665.466595:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609475968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432665.466603:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432665.466623:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432665.466641:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609472512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432665.466643:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432665.466647:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609476096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432665.466660:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432665.466664:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609476224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432665.466665:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432665.466683:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432665.466699:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609475840 00000100:00100000:2.0:1787432665.466704:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609475840 00000100:00100000:1.0:1787432665.466708:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609475968 00000100:00100000:1.0:1787432665.466711:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609475968 00000100:00100000:2.0:1787432665.466723:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609476096 00000100:00100000:1.0:1787432665.466723:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609476224 00000100:00100000:2.0:1787432665.466726:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609476096 00000100:00100000:1.0:1787432665.466726:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609476224 00000100:00100000:1.0:1787432665.466736:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787432665.466744:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1874258609475840:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787432665.466750:0:6500:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787432665 with bad export cookie 14587919725282715285 00000100:00100000:1.0:1787432665.466796:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1874258609475840:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (192us total) trans 0 rc -107/-107 00000100:00080000:3.0:1787432665.467141:0:15366:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787432665.467147:0:15366:0:(import.c:65:import_set_state_nolock()) ffff94843c609800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787432665.467254:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.124@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787432665.467258:0:3644:0:(import.c:65:import_set_state_nolock()) ffff948406158800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787432665.467261:0:3644:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.124@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1787432665.467621:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787432665.467646:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787432665.467651:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304644380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3641:x1874258609475968:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787432665.467657:0:6500:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787432665 with bad export cookie 14587919725282715285 00000100:00100000:1.0:1787432665.467703:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304644380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3641:x1874258609475968:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (1078us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787432665.467709:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787432665.467720:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1787432665.467724:0:15366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787432665.467724:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1874258609476224:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432665.467729:0:15366:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00020000:1.0:1787432665.467729:0:6500:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787432665 with bad export cookie 14587919725282715285 00000004:00080000:2.0:1787432665.467741:0:15366:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787432665.467754:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1874258609476224:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (1071us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787432665.467760:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787432665.467772:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787432665.467776:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304646d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3641:x1874258609476096:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787432665.467780:0:6500:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787432665 with bad export cookie 14587919725282715285 00000100:00100000:1.0:1787432665.467800:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304646d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3641:x1874258609476096:12345-0@lo:103:ldlm_bl.0 Request processed in 23us (1134us total) trans 0 rc -107/-107 00000100:00080000:2.0:1787432665.467806:0:15366:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787432665.467818:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1787432665.467822:0:15366:0:(import.c:65:import_set_state_nolock()) ffff9484034a7800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787432665.467845:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.124@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787432665.469289:0:15366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787432665.469294:0:15366:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1787432665.469318:0:15366:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787432665.469404:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609476352:0@lo:9:umount.0 00000100:00100000:2.0:1787432665.469462:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432665.469524:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609476352 00000100:00100000:2.0:1787432665.469530:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609476352 00000100:00100000:2.0:1787432665.469578:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787432665.469586:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874258609476352:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787432665.469612:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e9ac 00000100:00080000:2.0:1787432665.469621:0:8430:0:(import.c:65:import_set_state_nolock()) ffff948301e46000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787432665.469657:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1787432665.469787:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3640:x1874258609476352:12345-0@lo:9:umount.0 Request processed in 202us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432665.469795:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1787432665.469834:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484034a7800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787432665.469839:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787432665.469840:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787432665.469844:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609476352:0@lo:9:umount.0 00010000:00010000:2.0:1787432665.469865:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787432665.469873:0:15366:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787432665.469887:0:15366:0:(import.c:65:import_set_state_nolock()) ffff94843f86c800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787432665.469903:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609476480:0@lo:9:umount.0 00000100:00100000:2.0:1787432665.469925:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432665.469951:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609476480 00000100:00100000:2.0:1787432665.469954:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609476480 00000100:00100000:2.0:1787432665.469981:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787432665.469988:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874258609476480:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787432665.470001:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563eae0 00000100:00080000:2.0:1787432665.470013:0:8432:0:(import.c:65:import_set_state_nolock()) ffff94843f86e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787432665.470034:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1787432665.470138:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3640:x1874258609476480:12345-0@lo:9:umount.0 Request processed in 150us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432665.470144:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1787432665.470187:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843f86c800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787432665.470195:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787432665.470196:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787432665.470198:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609476480:0@lo:9:umount.0 00010000:00010000:2.0:1787432665.470219:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787432665.470244:0:15366:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff94841de9cd28) has no exports 00000100:00080000:2.0:1787432665.473243:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787432665.473254:0:6509:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432665.482458:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94842eb49450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1874258609475712:12345-0@lo:103:ldlm_bl.0 Request processed in 16840us (17019us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787432665.482474:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787432665.482654:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.124@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787432665.513091:0:3644:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.124@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787432665.513098:0:3644:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787432665.513108:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9484359e8e00 x1874258609474816/t0(0) o400->MGC192.168.204.124@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787432679 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432665.513122:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff948303909c00 x1874258609475712/t0(0) o103->MGC192.168.204.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787432681 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432665.513132:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9484348df100 x1874258609475840/t0(0) o103->MGC192.168.204.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787432681 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432665.513159:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9484359e9f80 x1874258609475968/t0(0) o103->MGC192.168.204.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787432681 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432665.513207:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9484348dfb80 x1874258609476096/t0(0) o103->MGC192.168.204.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787432681 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432665.513216:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9484359e9180 x1874258609476224/t0(0) o103->MGC192.168.204.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787432681 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787432665.513224:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787432665.513227:0:3644:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787432665.513229:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787432665.513481:0:3641:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff948406158800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1787432665.513623:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609475968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432665.513657:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0f84c3f-71b4-4eda-b290-0af337217d3a:3641:1874258609476096:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787432665.515377:0:3643:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff948406158800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1787432665.515406:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d0f84c3f-71b4-4eda-b290-0af337217d3a:3643:1874258609475712:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787432665.520222:0:3644:0:(import.c:65:import_set_state_nolock()) ffff948406158800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432665.520237:0:3644:0:(import.c:510:import_select_connection()) MGC192.168.204.124@tcp: connect to NID 0@lo last attempt 187 00000100:00080000:3.0:1787432665.520248:0:3644:0:(import.c:624:import_select_connection()) MGC192.168.204.124@tcp: import ffff948406158800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432665.520333:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94830379a680 x1874258609476608/t0(0) o250->MGC192.168.204.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432665.520383:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609474816:0@lo:400:kworker.0 00000100:00100000:3.0:1787432665.520414:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609476224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787432665.520419:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d0f84c3f-71b4-4eda-b290-0af337217d3a:3644:1874258609475840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432665.522445:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d0f84c3f-71b4-4eda-b290-0af337217d3a:3640:1874258609476608:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1787432665.522506:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874258609476608 offset 0 length 520: 4 00000020:00080000:2.0:1787432665.537963:0:15366:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff94841de9cd28) has no exports 00000020:01000000:3.0:1787432665.589948:0:15366:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94830269e4e0 - data ffff94842e2a9870/ffff94843c808400 00000020:01000000:3.0:1787432665.590302:0:15366:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948409385ea0 - data ffff94842e1a8870/ffff948434ba1400 00000001:00000004:3.0:1787432665.601746:0:15366:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1787432665.647509:0:15366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787432665.647518:0:15366:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1787432665.647528:0:15366:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787432665.654347:0:15366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787432665.654357:0:15366:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1787432665.654374:0:15366:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787432665.654376:0:15366:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787432665.656157:0:8796:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787432665.656189:0:8796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1787432665.656205:0:8796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787432665.656960:0:15366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787432665.656974:0:15366:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1787432665.656991:0:15366:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787432665.656994:0:15366:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787432665.657290:0:9953:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787432665.657295:0:9953:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1787432665.657305:0:9953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787432665.660974:0:15366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e7bb 00000020:00000080:1.0:1787432665.660987:0:15366:0:(genops.c:885:class_export_put()) final put ffff94843b952800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787432665.661242:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843b952800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787432665.665867:0:15366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e7d0 00000020:00000080:1.0:1787432665.665884:0:15366:0:(genops.c:885:class_export_put()) final put ffff94843b953000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787432665.665896:0:15366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1787432665.666035:0:15366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432665.666046:0:15366:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787432665.666052:0:15366:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff94841de98000) has no exports 00000004:01000000:1.0:1787432665.666264:0:15366:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787432665.666285:0:15366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ead9 00000020:00000080:1.0:1787432665.666291:0:15366:0:(genops.c:885:class_export_put()) final put ffff9483036e9800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787432665.666295:0:15366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787432665.666298:0:15366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432665.666326:0:15366:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787432665.666328:0:15366:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9484349d3370) has no exports 00000020:00000080:1.0:1787432665.666335:0:15366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ead2 00000020:00000080:1.0:1787432665.666339:0:15366:0:(genops.c:885:class_export_put()) final put ffff94843f86d000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1787432665.667779:0:15366:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787432665.667787:0:15366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787432665.667790:0:15366:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1787432665.667797:0:15366:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787432665.667800:0:15366:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787432665.667854:0:15366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432665.667864:0:15366:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787432665.667872:0:15366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e997 00000020:00000080:1.0:1787432665.667879:0:15366:0:(genops.c:885:class_export_put()) final put ffff948301e42800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787432665.667885:0:15366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787432665.667890:0:15366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432665.667895:0:15366:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787432665.667897:0:15366:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff94843b95b370) has no exports 00000020:00000080:1.0:1787432665.667988:0:15366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e990 00000020:00000080:1.0:1787432665.667992:0:15366:0:(genops.c:885:class_export_put()) final put ffff94843c7ef000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1787432665.668481:0:15366:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787432665.668485:0:15366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787432665.668488:0:15366:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1787432665.668491:0:15366:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787432665.668492:0:15366:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787432665.668518:0:15366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432665.668524:0:15366:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1787432665.668535:0:15366:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787432665.668828:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843b953000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:2.0:1787432665.668838:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9483036e9800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1787432665.668843:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843f86d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787432665.668847:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94843f86c800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1787432665.668853:0:36:0:(genops.c:885:class_export_put()) final put ffff94843f868800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787432665.668855:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843f868800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1787432665.668859:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787432665.669033:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948301e42800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1787432665.669040:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843c7ef000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787432665.669045:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9484034a7800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1787432665.669051:0:36:0:(genops.c:885:class_export_put()) final put ffff948301dd5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787432665.669053:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dd5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1787432665.669057:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787432665.669254:0:15366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e7f3 00000020:00000080:1.0:1787432665.669260:0:15366:0:(genops.c:885:class_export_put()) final put ffff94843c5ee000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787432665.669311:0:15366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1787432665.669316:0:15366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432665.669322:0:15366:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787432665.669332:0:15366:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff948433618000) has no exports 00000020:00000080:1.0:1787432665.669337:0:15366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e7ec 00000020:00000080:1.0:1787432665.669341:0:15366:0:(genops.c:885:class_export_put()) final put ffff94843c60f000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787432665.669366:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843c5ee000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787432665.669473:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843c60f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787432665.674263:0:15366:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1787432665.674281:0:15366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787432665.674286:0:15366:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1787432665.674295:0:15366:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787432665.674366:0:15366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432665.674378:0:15366:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787432665.674407:0:15366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432665.674410:0:15366:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787432665.674415:0:15366:0:(genops.c:885:class_export_put()) final put ffff948434b70800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787432665.674419:0:15366:0:(genops.c:844:class_export_destroy()) destroying export ffff948434b70800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787432665.674426:0:15366:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787432665.674614:0:15366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e7d7 00000020:00000080:2.0:1787432665.674623:0:15366:0:(genops.c:885:class_export_put()) final put ffff94843b957800/lustre-MDD0001_UUID 00000020:01000000:2.0:1787432665.674628:0:15366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1787432665.674632:0:15366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432665.674636:0:15366:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787432665.674640:0:15366:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff94843b958000) has no exports 00000020:00000080:3.0:1787432665.674732:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94843c609800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787432665.674740:0:36:0:(genops.c:885:class_export_put()) final put ffff94843c5ec000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787432665.674742:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843c5ec000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1787432665.674746:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787432665.674851:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843b957800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1787432665.675834:0:15366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787432665.675844:0:15366:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1787432665.675849:0:15366:0:(genops.c:885:class_export_put()) final put ffff94843b954800/lustre-MDD0001_UUID 00000020:00000080:3.0:1787432665.675853:0:15366:0:(genops.c:844:class_export_destroy()) destroying export ffff94843b954800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1787432665.675860:0:15366:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1787432665.676148:0:15366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e7de 00000020:00000080:3.0:1787432665.676154:0:15366:0:(genops.c:885:class_export_put()) final put ffff94843b951000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1787432665.676229:0:15366:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94842dfc5000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1787432665.676233:0:15366:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94842dfc5000 2 00000020:01000004:3.0:1787432665.676236:0:15366:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94842dfc5000 from lustre-MDT0001 00000020:00000080:3.0:1787432665.676254:0:15366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787432665.676259:0:15366:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1787432665.676262:0:15366:0:(genops.c:885:class_export_put()) final put ffff94843b954000/lustre-MDT0001_UUID 00000020:00000080:3.0:1787432665.676264:0:15366:0:(genops.c:844:class_export_destroy()) destroying export ffff94843b954000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1787432665.676281:0:15366:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:00000080:2.0:1787432665.676353:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843b951000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000004:3.0:1787432665.676389:0:15366:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1787432665.676394:0:15366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1787432665.676398:0:15366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787432665.676402:0:15366:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787432665.676408:0:15366:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff94843c7f6000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787432665.676414:0:15366:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9484093b4d28) has exports, disconnecting them 00000020:00080000:3.0:1787432665.676419:0:15366:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff94843c7f6000), last request at 1787432396 00000020:00000080:3.0:1787432665.676422:0:15366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e832 00000020:00080000:3.0:1787432665.676433:0:15366:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94843c7f6000): rc 0 00000020:00000080:3.0:1787432665.676438:0:15366:0:(genops.c:885:class_export_put()) final put ffff94843c7f6000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787432665.676505:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843c7f6000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1787432665.679230:0:15366:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1787432665.679248:0:15366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787432665.679252:0:15366:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787432665.679259:0:15366:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787432665.679300:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94843c7f3800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787432665.679492:0:15366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432665.679500:0:15366:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1787432665.679505:0:15366:0:(genops.c:885:class_export_put()) final put ffff94843c60d000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1787432665.679509:0:15366:0:(genops.c:844:class_export_destroy()) destroying export ffff94843c60d000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1787432665.679514:0:15366:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1787432665.679607:0:15366:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94842dfc5000 1 00000020:00000080:2.0:1787432665.679613:0:15366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e76e 00000020:00000080:2.0:1787432665.679620:0:15366:0:(genops.c:885:class_export_put()) final put ffff948434b76800/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1787432665.679628:0:15366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1787432665.679636:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948434b76800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787432665.679657:0:15366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432665.679663:0:15366:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787432665.679667:0:15366:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff94841de9b370) has no exports 00000020:00000080:2.0:1787432665.738043:0:15366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432665.738059:0:15366:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1787432665.738066:0:15366:0:(genops.c:885:class_export_put()) final put ffff9484348a0000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787432665.738072:0:15366:0:(genops.c:844:class_export_destroy()) destroying export ffff9484348a0000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1787432665.738086:0:15366:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1787432665.738379:0:15366:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94842dfc6000 00000020:01000000:2.0:1787432665.738403:0:15366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787432665.738407:0:15366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432665.738412:0:15366:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787432665.738415:0:15366:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9484336599b8) has no exports 00000100:00100000:1.0:1787432665.738982:0:6513:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff948411754200:6513] 0 exiting: rc = 1 00000100:00100000:1.0:1787432665.739120:0:6514:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff94843352c400:6514] 1 exiting: rc = 0 00000100:00100000:0.0:1787432665.739149:0:10165:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff94843f8d9600:10165] 4 exiting: rc = 0 00000100:00100000:0.0:1787432665.739314:0:9020:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff948301d8e400:9020] 3 exiting: rc = 0 00000100:00100000:2.0:1787432665.739521:0:6515:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff948427ec1000:6515] 2 exiting: rc = 0 00000100:00100000:2.0:1787432665.742432:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742444:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742449:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742466:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742472:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742478:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742483:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742489:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742496:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742501:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742507:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742513:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742518:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742524:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742530:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742535:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742555:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742562:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742573:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742579:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742585:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742590:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742595:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742600:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742605:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742612:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742617:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742622:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742627:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742633:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742638:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.742644:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743054:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743060:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743065:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743071:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743095:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743101:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743113:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743119:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743124:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743131:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743137:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743143:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743148:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743185:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743192:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743198:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743204:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743209:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743214:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743220:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743225:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743231:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743236:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743241:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743246:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743251:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743257:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743262:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743277:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743283:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743289:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.743302:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432665.756019:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff94842e97a000:6517] 1 exiting: rc = 0 00000100:00100000:1.0:1787432665.756376:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff94842e97a800:6516] 0 exiting: rc = 1 00000100:00100000:2.0:1787432665.758100:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758113:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758120:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758127:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758133:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758139:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758157:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758185:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758191:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758217:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758223:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758229:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758237:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758242:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758248:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758254:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758259:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758274:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758280:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758285:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758290:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758295:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758299:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758304:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758308:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758313:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758318:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758323:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758329:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758335:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758340:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758345:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758350:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758355:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758360:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758366:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758372:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758377:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758382:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758387:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758392:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758397:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758402:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758407:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758420:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758424:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758429:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758435:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758439:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758444:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758451:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758456:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758461:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758466:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758471:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758477:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758482:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758487:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758493:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758498:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758503:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758508:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758513:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.758518:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432665.760093:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff94842e97b200:6519] 1 exiting: rc = 0 00000100:00100000:2.0:1787432665.760325:0:7824:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9484349cb400:7824] 2 exiting: rc = 0 00000100:00100000:0.0:1787432665.760583:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff94842e97a200:6518] 0 exiting: rc = 1 00000100:00100000:2.0:1787432665.760673:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760684:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760696:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760729:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760739:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760747:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760756:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760765:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760773:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760782:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760790:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760800:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760807:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760815:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760837:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760866:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760875:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760881:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760887:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760894:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760917:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760926:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760932:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760939:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760945:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760952:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760959:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760984:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.760993:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761000:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761007:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761013:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761020:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761027:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761033:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761039:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761046:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761052:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761057:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761078:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761087:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761092:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761099:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761104:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761111:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761117:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761123:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761129:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761135:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761157:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761195:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761700:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761711:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761718:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761724:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761731:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761739:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761746:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761753:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761761:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761767:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761774:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761780:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432665.761796:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.782700:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff94840803a000:6521] 1 exiting: rc = 0 00000100:00100000:0.0:1787432665.783381:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff948406167000:6520] 0 exiting: rc = 1 00000100:00100000:3.0:1787432665.784143:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784203:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784209:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784214:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784219:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784226:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784231:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784237:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784242:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784246:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784252:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784257:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784262:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784276:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784282:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784287:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784313:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784318:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784323:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784327:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784332:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784347:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784353:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.784358:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785523:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785542:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785552:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785557:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785565:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785573:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785582:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785588:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785594:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785599:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785624:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785630:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785635:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785639:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785645:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785651:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785656:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785662:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785667:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785673:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785679:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785684:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785690:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785695:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785700:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785704:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785709:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785714:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785719:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785724:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785730:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785735:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785740:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785745:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785749:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785754:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785759:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785764:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785769:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.785774:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.791813:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff94840803b800:6523] 1 exiting: rc = 0 00000100:00100000:3.0:1787432665.792140:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff94840803a600:6522] 0 exiting: rc = 1 00000100:00100000:3.0:1787432665.792219:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792228:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792235:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792535:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792542:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792548:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792553:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792559:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792564:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792568:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792574:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792578:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792584:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792589:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792594:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792598:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792603:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792608:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792613:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792619:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792624:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792629:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792634:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792639:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792644:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792649:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792655:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792660:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792665:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792669:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792677:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792683:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792688:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792693:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792698:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792703:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792708:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792713:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792725:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792730:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792734:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792739:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792745:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792750:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792755:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792760:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792765:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792770:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792774:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792779:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792784:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792789:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792794:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792799:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792805:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792818:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792823:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792828:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792833:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792838:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792843:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792947:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792955:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.792960:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.794295:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff94840803b400:6524] 0 exiting: rc = 1 00000100:00100000:1.0:1787432665.795493:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff94840803b000:6525] 1 exiting: rc = 0 00000100:00100000:3.0:1787432665.798383:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798393:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798399:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798472:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798478:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798484:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798489:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798498:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798521:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798526:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798531:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798536:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798542:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798547:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798552:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798557:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798562:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798567:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798573:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798578:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798584:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798589:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798594:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798598:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798603:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798608:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798614:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798620:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798625:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798629:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798633:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798638:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798643:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798649:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798655:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798660:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798665:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798670:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798675:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798680:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798686:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798691:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798695:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798709:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798715:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798720:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798725:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798730:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798735:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798741:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798746:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798751:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798756:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798761:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798765:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798770:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.798774:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.799117:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.799124:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.799129:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.799134:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.799139:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.799143:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.799148:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.801671:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9484033ea400:6528] 2 exiting: rc = 0 00000100:00100000:1.0:1787432665.803106:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff948402c71600:6526] 0 exiting: rc = 1 00000100:00100000:1.0:1787432665.803817:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff948402c70400:6527] 1 exiting: rc = 0 00000100:00100000:3.0:1787432665.803882:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.803889:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.803896:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.803912:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.803919:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.803925:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.803931:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.803936:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.803942:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.803948:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.803954:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.803971:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804002:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804019:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804025:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804032:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804038:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804044:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804051:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804057:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804065:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804071:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804078:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804085:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804091:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804098:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804105:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804112:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804120:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804126:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804132:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804138:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804155:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804187:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804195:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804202:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804225:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804232:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804238:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804243:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804249:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804256:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804262:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804281:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804287:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804292:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804298:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804304:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804317:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804324:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804330:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804336:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804344:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804350:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804356:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804362:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804368:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804374:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804382:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804388:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804394:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804400:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804406:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432665.804420:0:15366:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787432665.833323:0:15366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432665.833337:0:15366:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787432665.833343:0:15366:0:(genops.c:885:class_export_put()) final put ffff948427f85800/MDS_uuid 00000020:00000080:2.0:1787432665.833347:0:15366:0:(genops.c:844:class_export_destroy()) destroying export ffff948427f85800/MDS_uuid for MDS 00000020:01000000:2.0:1787432665.833358:0:15366:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787432665.833513:0:15366:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1787432666.320017:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432667.342420:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432668.365207:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787432668.620257:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d0f84c3f-71b4-4eda-b290-0af337217d3a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787432668.620267:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) d0f84c3f-71b4-4eda-b290-0af337217d3a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787432668.620271:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787432668.620274:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787432668.620278:0:36:0:(import.c:65:import_set_state_nolock()) ffff9484166d2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432668.620287:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 474 00000100:00080000:2.0:1787432668.620292:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787432668.620299:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9484166d2800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432668.620349:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9484348de300 x1874258609476736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432668.620389:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787432668.620393:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787432668.620395:0:36:0:(import.c:65:import_set_state_nolock()) ffff94843c7ed800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432668.620398:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 474 00000100:00080000:2.0:1787432668.620401:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787432668.620405:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94843c7ed800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432668.620418:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9484348ded80 x1874258609476992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787432668.620478:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874258609476736:0@lo:38:kworker.0 00000400:00000100:2.0:1787432668.620531:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609476736 offset 0 length 520: 4 00000100:00100000:2.0:1787432668.620695:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874258609476992:0@lo:38:kworker.0 00000400:00000100:2.0:1787432668.620715:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609476992 offset 0 length 520: 4 00000100:00100000:2.0:1787432668.620752:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432668.620760:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609476864:0@lo:400:kworker.0 00000400:00000100:2.0:1787432668.620780:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609476864 offset 0 length 224: 4 00000100:00100000:1.0:1787432668.621613:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609477120:0@lo:400:kworker.0 00000400:00000100:1.0:1787432668.621647:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609477120 offset 0 length 224: 4 00010000:00010000:2.0:1787432669.390081:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787432670.213001:0:15567:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787432670.229831:0:15567:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787432670.229981:0:15567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33563ebab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432670.229997:0:15567:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33563ebab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ebb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432670.230005:0:15567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33563ebab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ebb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432670.230026:0:15567:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33563ebab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ebb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432670.230052:0:15567:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787432670.230058:0:15567:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787432670.230083:0:15567:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787432670.230095:0:15567:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9484348de300 x1874258609476736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787432688 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787432670.230371:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432670.230379:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33563ebab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ebb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432670.230386:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ec00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1787432670.230390:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33563ebab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ebb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432670.230399:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33563ebab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563ebb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432670.230407:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33563ebab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563ebb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432670.230413:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787432670.230415:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787432670.230423:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787432670.230438:0:6502:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948406158800 00010000:00010000:3.0:1787432670.230443:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33563ebab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563ebb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432670.230449:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff94843f85ec00/0xca72b3b33563ebab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563ebb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432670.230460:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432670.230462:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432670.230464:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432670.230614:0:15567:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787432670.230622:0:15567:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787432670.230628:0:15567:0:(import.c:65:import_set_state_nolock()) ffff9484166d2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787432670.230707:0:15567:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787432670.230710:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874258609476736:0@lo:38:kworker.0 00000100:00100000:2.0:1787432670.230712:0:15567:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9484348de300 x1874258609476736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787432688 ref 1 fl Complete:ENQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432670.230720:0:15567:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787432670.230726:0:15567:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787432670.231911:0:15567:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787432670.231924:0:15567:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9484348de680 x1874258609476864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432684 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432670.232005:0:15567:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787432670.232011:0:15567:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787432670.232035:0:15567:0:(import.c:65:import_set_state_nolock()) ffff948301dd3000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787432670.232097:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609476864:0@lo:400:kworker.0 00000100:00100000:1.0:1787432670.232148:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1874258609477248:0@lo:39:umount.0 00000400:00000100:1.0:1787432670.232291:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609477248 offset 0 length 224: 4 00010000:00010000:2.0:1787432670.411428:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787432670.667923:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d0f84c3f-71b4-4eda-b290-0af337217d3a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787432670.667936:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) d0f84c3f-71b4-4eda-b290-0af337217d3a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432670.667940:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787432670.667944:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787432670.668072:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609477376:0@lo:400:kworker.0 00000400:00000100:1.0:1787432670.668139:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609477376 offset 0 length 224: 4 00000001:00100000:0.0:1787432670.671294:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787432670.671304:0:9509:0:(genops.c:885:class_export_put()) final put ffff94843f868000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787432670.672844:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787432670.672855:0:8425:0:(genops.c:885:class_export_put()) final put ffff948301e42000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787432670.675249:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843f868000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787432670.675336:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948301e42000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787432670.675359:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94843f86e000 for lustre-OST0001 00000020:00000080:2.0:1787432670.675382:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948301e46000 for lustre-OST0000 00010000:00010000:2.0:1787432671.435431:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432672.459347:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432673.483527:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787432673.675593:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) d0f84c3f-71b4-4eda-b290-0af337217d3a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787432673.675606:0:474:0:(pinger.c:247:ptlrpc_pinger_process_import()) d0f84c3f-71b4-4eda-b290-0af337217d3a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432673.675618:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787432673.675623:0:474:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787432673.675912:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432673.675932:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609477504:0@lo:400:kworker.0 00000400:00000100:3.0:1787432673.675987:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609477504 offset 0 length 224: 4 00010000:00010000:2.0:1787432674.507494:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432675.342503:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432665/real 1787432665] req@ffff94830379a680 x1874258609476608/t0(0) o250->MGC192.168.204.124@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787432675 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432675.342538:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94830379a680 x1874258609476608/t0(0) o250->MGC192.168.204.124@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787432675 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787432675.342559:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948406158800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432675.342597:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787432675.342602:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d0f84c3f-71b4-4eda-b290-0af337217d3a:3640:1874258609476608:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1787432675.342706:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d0f84c3f-71b4-4eda-b290-0af337217d3a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787432675.342711:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787432675.342714:0:36:0:(import.c:65:import_set_state_nolock()) ffff948406158800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432675.342719:0:36:0:(import.c:510:import_select_connection()) MGC192.168.204.124@tcp: connect to NID 0@lo last attempt 476 00000100:00080000:2.0:1787432675.342724:0:36:0:(import.c:589:import_select_connection()) MGC192.168.204.124@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787432675.342730:0:36:0:(import.c:624:import_select_connection()) MGC192.168.204.124@tcp: import ffff948406158800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432675.342758:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9484348dd500 x1874258609477632/t0(0) o250->MGC192.168.204.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432675.342783:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787432675.342787:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787432675.342875:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432675.342889:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609477760:0@lo:400:kworker.0 00000400:00000100:0.0:1787432675.342938:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609477760 offset 0 length 224: 4 00000100:00100000:1.0:1787432675.343264:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d0f84c3f-71b4-4eda-b290-0af337217d3a:3640:1874258609477632:0@lo:250:kworker.0 00000400:00000100:1.0:1787432675.343289:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874258609477632 offset 0 length 520: 4 00010000:00010000:3.0:1787432675.532628:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432676.557615:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432677.580818:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432678.603410:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432679.629387:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787432680.399534:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) d0f84c3f-71b4-4eda-b290-0af337217d3a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787432680.399545:0:474:0:(pinger.c:247:ptlrpc_pinger_process_import()) d0f84c3f-71b4-4eda-b290-0af337217d3a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432680.399549:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787432680.399552:0:474:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787432680.399772:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432680.399794:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609477888:0@lo:400:kworker.0 00000400:00000100:1.0:1787432680.399847:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609477888 offset 0 length 224: 4 00000100:00100000:2.0:1787432680.460102:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432670/real 1787432670] req@ffff9484348df800 x1874258609477248/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787432680 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432680.460136:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9484348df800 x1874258609477248/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787432680 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787432680.460156:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948301dd3000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787432680.460196:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1874258609477248:0@lo:39:umount.0 00000100:00080000:0.0:1787432680.460283:0:15567:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787432680.460287:0:15567:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787432680.460293:0:15567:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787432680.461550:0:15567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401682c00/0xca72b3b33563ebb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ebc0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432680.461578:0:15567:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401682c00/0xca72b3b33563ebb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ebc0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432680.461585:0:15567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948401682c00/0xca72b3b33563ebb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ebc0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432680.461592:0:15567:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff948401682c00/0xca72b3b33563ebb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ebc0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432680.461618:0:15567:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787432680.461626:0:15567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94840149e000/0xca72b3b33563ee2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ee36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432680.461634:0:15567:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94840149e000/0xca72b3b33563ee2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ee36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432680.461641:0:15567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94840149e000/0xca72b3b33563ee2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ee36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432680.461647:0:15567:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff94840149e000/0xca72b3b33563ee2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ee36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432680.461667:0:15567:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787432680.461764:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787432680.461773:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948401682c00/0xca72b3b33563ebb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ebc0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432680.461782:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948401682c00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1787432680.461786:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948401682c00/0xca72b3b33563ebb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ebc0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432680.461796:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948401682c00/0xca72b3b33563ebb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563ebc0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432680.461815:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948401682c00/0xca72b3b33563ebb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563ebc0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432680.461821:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787432680.461823:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1787432680.461826:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1787432680.461839:0:6502:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948406158800 00010000:00010000:3.0:1787432680.461843:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948401682c00/0xca72b3b33563ebb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563ebc0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432680.461849:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948401682c00/0xca72b3b33563ebb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563ebc0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432680.461864:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432680.461868:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff94840149e000/0xca72b3b33563ee2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ee36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432680.461873:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94840149e000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1787432680.461876:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff94840149e000/0xca72b3b33563ee2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ee36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432680.461883:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff94840149e000/0xca72b3b33563ee2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563ee36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432680.461889:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff94840149e000/0xca72b3b33563ee2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563ee36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432680.461894:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787432680.461897:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787432680.461904:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787432680.461912:0:6502:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948406158800 00010000:00010000:3.0:1787432680.461915:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff94840149e000/0xca72b3b33563ee2f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563ee36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432680.461920:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff94840149e000/0xca72b3b33563ee2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563ee36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432680.461943:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432680.461945:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432680.461947:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432680.461988:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787432680.462016:0:15567:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787432680.462047:0:15567:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787432680.462051:0:15567:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787432680.462056:0:15567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787432680.462062:0:15567:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787432680.462066:0:15567:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff94843b95cd28) has no exports 00000020:00080000:0.0:1787432680.462094:0:15567:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff94843b95cd28) has no exports 00000020:01000000:0.0:1787432680.467646:0:15567:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94830269e120 - data ffff94842e2d41b0/ffff94843c808800 00000020:01000000:0.0:1787432680.467949:0:15567:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff948435a10540 - data ffff94842e25c510/ffff948301e5ac00 00100000:10000000:0.0:1787432680.488560:0:15567:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787432680.503142:0:15567:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e90b 00000020:00000080:0.0:1787432680.503157:0:15567:0:(genops.c:885:class_export_put()) final put ffff948301dd3800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787432680.503352:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dd3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:3.0:1787432680.503455:0:15567:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948435a21000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787432680.503460:0:15567:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948435a21000 2 00000020:01000004:3.0:1787432680.503463:0:15567:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff948435a21000 from lustre-OST0000 00000020:00000080:3.0:1787432680.503490:0:15567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787432680.503500:0:15567:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787432680.503503:0:15567:0:(genops.c:885:class_export_put()) final put ffff948301dd1000/lustre-OST0000_UUID 00000020:00000080:3.0:1787432680.503505:0:15567:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dd1000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787432680.503515:0:15567:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787432680.503568:0:15567:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787432680.503572:0:15567:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787432680.503576:0:15567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787432680.503580:0:15567:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787432680.503587:0:15567:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff94843b956000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787432680.503593:0:15567:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff94843361cd28) has exports, disconnecting them 00000020:00080000:3.0:1787432680.503598:0:15567:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff94843b956000), last request at 1787432419 00000020:00000080:3.0:1787432680.503602:0:15567:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e935 00000020:00080000:3.0:1787432680.503612:0:15567:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94843b956000): rc 0 00000020:00000080:3.0:1787432680.503617:0:15567:0:(genops.c:885:class_export_put()) final put ffff94843b956000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787432680.504225:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff94843b956000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787432680.507238:0:15567:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787432680.507247:0:15567:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787432680.507251:0:15567:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787432680.507260:0:15567:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787432680.507340:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9484166d2800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787432680.507454:0:15567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432680.507461:0:15567:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787432680.507467:0:15567:0:(genops.c:885:class_export_put()) final put ffff94843b955000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787432680.507474:0:15567:0:(genops.c:844:class_export_destroy()) destroying export ffff94843b955000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787432680.507479:0:15567:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1787432680.507537:0:15567:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787432680.507540:0:15567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432680.507544:0:15567:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787432680.507550:0:15567:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff948301dd7800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787432680.507566:0:15567:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff94843b9599b8) has exports, disconnecting them 00000020:00080000:2.0:1787432680.507570:0:15567:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff948301dd7800), last request at 1787432419 00000020:00000080:2.0:1787432680.507573:0:15567:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e94a 00000020:00080000:2.0:1787432680.507586:0:15567:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff948301dd7800): rc 0 00000020:00000080:2.0:1787432680.507590:0:15567:0:(genops.c:885:class_export_put()) final put ffff948301dd7800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1787432680.507700:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dd7800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1787432680.555839:0:15567:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787432680.556008:0:15567:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787432680.556013:0:15567:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787432680.556022:0:15567:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787432680.556365:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948301dd3000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787432680.556412:0:15567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787432680.556423:0:15567:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1787432680.556428:0:15567:0:(genops.c:885:class_export_put()) final put ffff948301dd1800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1787432680.556432:0:15567:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dd1800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1787432680.556441:0:15567:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1787432680.556510:0:15567:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948435a21000 1 00000020:00000080:3.0:1787432680.556516:0:15567:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e8d3 00000020:00000080:3.0:1787432680.556522:0:15567:0:(genops.c:885:class_export_put()) final put ffff948435aed800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787432680.556535:0:15567:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787432680.556539:0:15567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787432680.556542:0:15567:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787432680.556546:0:15567:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9484093b3370) has no exports 00000020:00000080:0.0:1787432680.556836:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff948435aed800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787432680.625380:0:15567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787432680.625395:0:15567:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787432680.625400:0:15567:0:(genops.c:885:class_export_put()) final put ffff948435a22000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787432680.625404:0:15567:0:(genops.c:844:class_export_destroy()) destroying export ffff948435a22000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787432680.625414:0:15567:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787432680.625536:0:15567:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff948435a22800 00000020:02000400:0.0:1787432680.625588:0:15567:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787432680.658462:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432681.678386:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432682.705560:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432683.724225:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432684.763071:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1787432685.006771:0:3641:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432668/real 1787432668] req@ffff9484348dd880 x1874258609477120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787432684 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432685.042492:0:3641:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9484348dd880 x1874258609477120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787432684 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787432685.042509:0:3641:0:(import.c:65:import_set_state_nolock()) ffff94843f84e000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787432685.042513:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787432685.056206:0:3641:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1787432685.056363:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d0f84c3f-71b4-4eda-b290-0af337217d3a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787432685.056370:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) d0f84c3f-71b4-4eda-b290-0af337217d3a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787432685.056373:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787432685.056376:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787432685.056379:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787432685.056382:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787432685.056386:0:36:0:(import.c:65:import_set_state_nolock()) ffff94843f84e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432685.056394:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 254 00000100:00080000:3.0:1787432685.056403:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff94843f84e000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432685.056448:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94830379aa00 x1874258609478016/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432685.056499:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609477120:0@lo:400:kworker.0 00000100:00100000:2.0:1787432685.061781:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1874258609478016:0@lo:38:kworker.0 00000400:00000100:2.0:1787432685.062036:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258609478016 offset 0 length 520: 4 00000020:01000004:0.0:1787432685.191986:0:15769:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787432685.207353:0:15769:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787432685.207445:0:15769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563eb8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eb96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432685.207462:0:15769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563eb8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563eb96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432685.207470:0:15769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563eb8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563eb96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432685.207478:0:15769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563eb8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563eb96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432685.207523:0:15769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787432685.207530:0:15769:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787432685.207555:0:15769:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787432685.207568:0:15769:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9484348ded80 x1874258609476992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787432688 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432685.207666:0:15769:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787432685.207674:0:15769:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787432685.207682:0:15769:0:(import.c:65:import_set_state_nolock()) ffff94843c7ed800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787432685.207688:0:15769:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787432685.207692:0:15769:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9484348ded80 x1874258609476992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787432688 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432685.207700:0:15769:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787432685.207703:0:15769:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00010000:00010000:1.0:1787432685.207757:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432685.207765:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563eb8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563eb96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432685.207774:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fd400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432685.207778:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563eb8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563eb96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432685.207788:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563eb8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563eb96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432685.207794:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563eb8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563eb96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432685.207800:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787432685.207803:0:9519:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787432685.207805:0:9519:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787432685.207818:0:9519:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948406158800 00010000:00010000:1.0:1787432685.207822:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563eb8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563eb96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432685.207829:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484013fd400/0xca72b3b33563eb8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563eb96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432685.207865:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432685.207867:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432685.207870:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432685.208013:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874258609476992:0@lo:38:kworker.0 00000100:00080000:1.0:1787432685.213750:0:15769:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787432685.213770:0:15769:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94830390b480 x1874258609477376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432686 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432685.213801:0:15769:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff948303909f80 x1874258609477504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432689 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432685.213830:0:15769:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9484348dc380 x1874258609477760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432691 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432685.213854:0:15769:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff948303908e00 x1874258609477888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432696 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432685.213862:0:15769:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94830379aa00 x1874258609478016/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787432695 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432685.213875:0:15769:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787432685.213882:0:15769:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787432685.213901:0:15769:0:(import.c:65:import_set_state_nolock()) ffff94843f84e000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787432685.213908:0:15769:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787432685.213912:0:15769:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94830390b480 x1874258609477376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432686 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432685.213920:0:15769:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff948303909f80 x1874258609477504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432689 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432685.213928:0:15769:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9484348dc380 x1874258609477760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432691 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432685.213935:0:15769:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff948303908e00 x1874258609477888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432696 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432685.213965:0:15769:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94830379aa00 x1874258609478016/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787432695 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432685.213971:0:15769:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787432685.213975:0:15769:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:0.0:1787432685.214106:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609477888:0@lo:400:kworker.0 00000100:00100000:0.0:1787432685.214140:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609477376:0@lo:400:kworker.0 00000100:00100000:0.0:1787432685.214205:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609477760:0@lo:400:kworker.0 00000100:00100000:1.0:1787432685.215292:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609477504:0@lo:400:kworker.0 00000100:00100000:1.0:1787432685.215333:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1874258609478016:0@lo:38:kworker.0 00010000:00010000:1.0:1787432685.216500:0:15769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563eb9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563eba4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432685.216516:0:15769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563eb9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563eba4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432685.216524:0:15769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563eb9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563eba4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432685.216530:0:15769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563eb9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563eba4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432685.216551:0:15769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432685.216558:0:15769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303850a00/0xca72b3b33563ee21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ee28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432685.216565:0:15769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303850a00/0xca72b3b33563ee21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ee28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432685.216571:0:15769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303850a00/0xca72b3b33563ee21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ee28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432685.216651:0:15769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.124@tcp lock: ffff948303850a00/0xca72b3b33563ee21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xca72b3b33563ee28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432685.216664:0:15769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787432685.216668:0:15769:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787432685.216696:0:15769:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787432685.216700:0:15769:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787432685.216704:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432685.216710:0:15769:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787432685.216713:0:15769:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9483030f4d28) has no exports 00000020:00080000:1.0:1787432685.216739:0:15769:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9483030f4d28) has no exports 00010000:00010000:0.0:1787432685.218712:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787432685.218726:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563eb9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563eba4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432685.218739:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fd000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1787432685.218743:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563eb9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563eba4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432685.218754:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563eb9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563eba4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432685.218777:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563eb9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563eba4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432685.218783:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787432685.218785:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1787432685.218788:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1787432685.218805:0:6502:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948406158800 00010000:00010000:0.0:1787432685.218809:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563eb9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563eba4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432685.218816:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484013fd000/0xca72b3b33563eb9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563eba4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432685.218830:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432685.218835:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948303850a00/0xca72b3b33563ee21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ee28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432685.218855:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1787432685.218858:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948303850a00/0xca72b3b33563ee21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xca72b3b33563ee28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432685.218864:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948303850a00/0xca72b3b33563ee21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563ee28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432685.218870:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948303850a00/0xca72b3b33563ee21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563ee28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432685.218875:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787432685.218878:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787432685.218896:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787432685.218904:0:6502:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948406158800 00010000:00010000:0.0:1787432685.218907:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948303850a00/0xca72b3b33563ee21 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563ee28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432685.218914:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948303850a00/0xca72b3b33563ee21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563ee28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432685.218927:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432685.218928:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432685.218931:0:6502:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432685.224706:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787432685.226559:0:15769:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94830269ed80 - data ffff94842e2da948/ffff94843f8c8400 00000020:01000000:0.0:1787432685.232064:0:15769:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9483032bc780 - data ffff948302029d80/ffff948303667400 00100000:10000000:1.0:1787432685.266427:0:15769:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787432685.278848:0:15769:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ea31 00000020:00000080:0.0:1787432685.278862:0:15769:0:(genops.c:885:class_export_put()) final put ffff94843f84a800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787432685.278896:0:15769:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948435bcb800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787432685.278901:0:15769:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948435bcb800 2 00000020:01000004:0.0:1787432685.278904:0:15769:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff948435bcb800 from lustre-OST0001 00000020:00000080:0.0:1787432685.278940:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787432685.278949:0:15769:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787432685.278953:0:15769:0:(genops.c:885:class_export_put()) final put ffff94843f84b800/lustre-OST0001_UUID 00000020:00000080:0.0:1787432685.278955:0:15769:0:(genops.c:844:class_export_destroy()) destroying export ffff94843f84b800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787432685.278963:0:15769:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1787432685.279236:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843f84a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1787432685.279315:0:15769:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d0f84c3f-71b4-4eda-b290-0af337217d3a->MGS 00010000:00010000:0.0:1787432685.279332:0:15769:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b33563e78a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563e791 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432685.279346:0:15769:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b33563e78a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563e791 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432685.279354:0:15769:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787432685.279357:0:15769:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787432685.279372:0:15769:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787432685.279389:0:15769:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948406158800 00010000:00010000:0.0:1787432685.279393:0:15769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b33563e78a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563e791 expref: -99 pid: 7443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432685.279409:0:15769:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948303012c00/0xca72b3b33563ebff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xca72b3b33563ec06 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432685.279416:0:15769:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948303012c00/0xca72b3b33563ebff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xca72b3b33563ec06 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432685.279422:0:15769:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787432685.279424:0:15769:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787432685.279426:0:15769:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787432685.279434:0:15769:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff948406158800 00010000:00010000:0.0:1787432685.279436:0:15769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948303012c00/0xca72b3b33563ebff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xca72b3b33563ec06 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787432685.279452:0:15769:0:(import.c:65:import_set_state_nolock()) ffff948406158800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787432685.279456:0:15769:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787432685.279459:0:15769:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787432685.279460:0:15769:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787432685.279465:0:15769:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787432685.279478:0:15769:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9484348dd500 x1874258609477632/t0(0) o250->MGC192.168.204.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787432690 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787432685.280220:0:15769:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787432685.280227:0:15769:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:2.0:1787432685.286397:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d0f84c3f-71b4-4eda-b290-0af337217d3a:3640:1874258609477632:0@lo:250:kworker.0 10000000:01000000:0.0:1787432685.293371:0:15769:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787432685.293391:0:15769:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563e687 00000020:00000080:0.0:1787432685.293403:0:15769:0:(genops.c:885:class_export_put()) final put ffff948427f81000/d0f84c3f-71b4-4eda-b290-0af337217d3a 00000020:01000000:0.0:1787432685.293418:0:15769:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.124@tcp (flags='') 00000020:00000080:0.0:1787432685.293451:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787432685.293474:0:15769:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.124@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787432685.293479:0:15769:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9484336199b8) has no exports 00000020:00000080:3.0:1787432685.293961:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948427f81000/d0f84c3f-71b4-4eda-b290-0af337217d3a for MGC192.168.204.124@tcp 10000000:01000000:0.0:1787432685.294759:0:6511:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787432685.294903:0:15769:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.124@tcp: client import never connected 00000100:00080000:3.0:1787432685.294908:0:15769:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787432685.294912:0:15769:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787432685.294916:0:15769:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787432685.294918:0:15769:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787432685.295001:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787432685.295009:0:15769:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.124@tcp (uuid d0f84c3f-71b4-4eda-b290-0af337217d3a) 00000020:01000000:3.0:1787432685.295019:0:15769:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787432685.295026:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787432685.295031:0:15769:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787432685.295038:0:15769:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff948301dd5800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787432685.295044:0:15769:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9483030f19b8) has exports, disconnecting them 00000020:00080000:3.0:1787432685.295048:0:15769:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff948301dd5800), last request at 1787432443 00000020:00000080:3.0:1787432685.295053:0:15769:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ea5b 00000020:00080000:3.0:1787432685.295070:0:15769:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff948301dd5800): rc 0 00000020:00000080:3.0:1787432685.295076:0:15769:0:(genops.c:885:class_export_put()) final put ffff948301dd5800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787432685.295848:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dd5800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787432685.299552:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff948406158800 for MGC192.168.204.124@tcp 00000020:00000080:2.0:1787432685.299568:0:36:0:(genops.c:885:class_export_put()) final put ffff94840615e800/d0f84c3f-71b4-4eda-b290-0af337217d3a 00000020:00000080:2.0:1787432685.299571:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94840615e800/d0f84c3f-71b4-4eda-b290-0af337217d3a for MGC192.168.204.124@tcp 00000020:01000000:2.0:1787432685.299597:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.124@tcp (d0f84c3f-71b4-4eda-b290-0af337217d3a) 00010000:01000000:2.0:1787432685.300374:0:15769:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787432685.300380:0:15769:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787432685.300384:0:15769:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787432685.300391:0:15769:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787432685.300589:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432685.300597:0:15769:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1787432685.300604:0:15769:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787432685.300609:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432685.300614:0:15769:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787432685.300623:0:15769:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff94843c5ea800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787432685.300629:0:15769:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9484349d19b8) has exports, disconnecting them 00000020:00080000:2.0:1787432685.300633:0:15769:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff94843c5ea800), last request at 1787432443 00000020:00000080:2.0:1787432685.300637:0:15769:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ea70 00000020:00080000:2.0:1787432685.300653:0:15769:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94843c5ea800): rc 0 00000020:00000080:2.0:1787432685.300658:0:15769:0:(genops.c:885:class_export_put()) final put ffff94843c5ea800/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1787432685.301401:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94843c7ed800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787432685.301412:0:36:0:(genops.c:885:class_export_put()) final put ffff94843f84f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787432685.301414:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843f84f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787432685.301420:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787432685.301480:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94843c5ea800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1787432685.325314:0:15769:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787432685.325324:0:15769:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787432685.325327:0:15769:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787432685.325336:0:15769:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787432685.325367:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94843f84e000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1787432685.335230:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787432685.335406:0:6502:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787432685.340064:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1787432685.340306:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff948411697400:6496] 0 exiting: rc = 1 00000100:00100000:0.0:1787432685.343333:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff948411696200:6497] 1 exiting: rc = 0 00000100:00100000:3.0:1787432685.343784:0:7455:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff948434af3000:7455] 2 exiting: rc = 0 00000100:00100000:0.0:1787432685.345559:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.345906:0:6499:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff948427ec7600:6499] 1 exiting: rc = 0 00000100:00100000:3.0:1787432685.350449:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff948411696e00:6498] 0 exiting: rc = 1 00000100:00100000:0.0:1787432685.353326:0:7465:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff94843c7e5400:7465] 3 exiting: rc = 0 00000100:00100000:0.0:1787432685.375559:0:6500:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff948420f1ee00:6500] 2 exiting: rc = 0 00000100:00100000:0.0:1787432685.375707:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375716:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375723:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375730:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375736:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375742:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375749:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375771:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375777:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375784:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375790:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375797:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375803:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375812:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375829:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375836:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375843:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375850:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375857:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375864:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375893:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375898:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375904:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375910:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375915:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375920:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375926:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375932:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375938:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375943:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375948:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375954:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375958:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375963:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375968:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375974:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375979:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375983:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375988:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.375993:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376000:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376498:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376516:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376521:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376526:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376531:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376536:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376542:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376547:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376552:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376557:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376562:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376567:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376571:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376586:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376592:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376597:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376602:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376609:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376614:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376619:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376624:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376629:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.376634:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787432685.381102:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787432685.381115:0:15769:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1787432685.381132:0:15769:0:(genops.c:885:class_export_put()) final put ffff9484359a6000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1787432685.381137:0:15769:0:(genops.c:844:class_export_destroy()) destroying export ffff9484359a6000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1787432685.381144:0:15769:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1787432685.381215:0:15769:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948435bcb800 1 00000020:00000080:0.0:1787432685.381221:0:15769:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xca72b3b33563ea00 00000020:00000080:0.0:1787432685.381227:0:15769:0:(genops.c:885:class_export_put()) final put ffff948301dc1000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787432685.381239:0:15769:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787432685.381250:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff948301dc1000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787432685.381261:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787432685.381276:0:15769:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787432685.381279:0:15769:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9483031a99b8) has no exports 00000020:00000080:1.0:1787432685.552143:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432685.552157:0:15769:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787432685.552187:0:15769:0:(genops.c:885:class_export_put()) final put ffff948435bca000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787432685.552192:0:15769:0:(genops.c:844:class_export_destroy()) destroying export ffff948435bca000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787432685.552199:0:15769:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787432685.552514:0:15769:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff948435bca800 00000020:01000000:1.0:1787432685.554661:0:15769:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787432685.554676:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432685.554685:0:15769:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787432685.554689:0:15769:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9484349d4d28) has no exports 00000020:00000080:1.0:1787432685.554735:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432685.554745:0:15769:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787432685.554749:0:15769:0:(genops.c:885:class_export_put()) final put ffff948435aef000/OSS_uuid 00000020:00000080:1.0:1787432685.554751:0:15769:0:(genops.c:844:class_export_destroy()) destroying export ffff948435aef000/OSS_uuid for OSS 00000020:01000000:1.0:1787432685.554756:0:15769:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1787432685.554829:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff94843590c800:8430] 0 exiting: rc = 1 00000100:00080000:2.0:1787432685.555639:0:6509:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787432685.555802:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9484349ca800:8431] 1 exiting: rc = 0 00000100:00100000:2.0:1787432685.555852:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff948434a56a00:8432] 2 exiting: rc = 0 00000100:00100000:2.0:1787432685.555927:0:8806:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff94830273ec00:8806] 3 exiting: rc = 0 00000100:00100000:1.0:1787432685.556680:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556698:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556713:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556721:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556727:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556732:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556738:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556743:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556749:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556755:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556761:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556767:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556772:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556778:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556783:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556788:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556794:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556799:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556804:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556810:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556815:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556821:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556826:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556832:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556837:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556842:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556848:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556853:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556859:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556864:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556871:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556886:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556893:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556898:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556904:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556909:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556923:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556928:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556935:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556940:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556945:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556951:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556957:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556962:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556968:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556974:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556979:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556985:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556991:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.556997:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.557011:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.557018:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.557024:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.557030:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.557036:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.557042:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.557047:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.557053:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.557058:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.557064:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.557069:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.557074:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.557080:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.557090:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787432685.562465:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff948410d64000:8433] 0 exiting: rc = 1 00000100:00100000:3.0:1787432685.565723:0:12227:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff948303641600:12227] 2 exiting: rc = 0 00000100:00100000:0.0:1787432685.567740:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff948410d65200:8434] 1 exiting: rc = 0 00000100:00100000:1.0:1787432685.568338:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568350:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568356:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568362:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568367:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568373:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568378:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568404:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568409:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568414:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568419:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568424:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568429:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568434:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568440:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568444:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568451:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568456:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568461:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568466:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568471:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568476:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568481:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568486:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568492:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568497:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568503:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568508:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568514:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568519:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.568525:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569328:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569337:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569342:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569347:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569353:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569358:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569363:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569368:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569373:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569378:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569383:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569399:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569404:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569408:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569413:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569418:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569423:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569429:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569434:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569440:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569445:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569450:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569456:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569461:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569467:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569471:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569476:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569481:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569486:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569491:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569496:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569501:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.569507:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.575781:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff94843c7e0800:8437] 2 exiting: rc = 0 00000100:00100000:0.0:1787432685.576054:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff94843c751200:8436] 1 exiting: rc = 0 00000100:00100000:1.0:1787432685.576437:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff948410d65a00:8435] 0 exiting: rc = 1 00000100:00100000:3.0:1787432685.576762:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576771:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576793:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576799:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576805:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576832:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576839:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576844:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576850:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576855:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576860:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576866:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576871:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576886:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576894:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576901:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576907:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576913:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576919:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576925:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576930:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576936:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576942:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576947:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576952:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576957:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576963:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576969:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576974:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.576994:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577000:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577005:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577010:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577016:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577021:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577027:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577032:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577045:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577050:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577056:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577061:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577067:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577072:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577078:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577084:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577090:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577095:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577101:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577107:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577112:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577129:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577134:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577140:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577145:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577150:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577202:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577210:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577223:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577230:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577236:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577242:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577256:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577262:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.577274:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432685.596292:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff94843c73de00:8439] 1 exiting: rc = 0 00000100:00100000:3.0:1787432685.602393:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff94843c7e4000:8438] 0 exiting: rc = 1 00000100:00100000:0.0:1787432685.602573:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602581:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602586:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602591:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602596:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602602:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602607:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602612:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602617:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602622:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602627:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602632:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602637:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602643:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602648:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602654:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602659:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602664:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602669:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602675:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602680:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602686:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602691:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602696:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602701:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602706:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602712:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602717:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602722:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602727:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602733:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602765:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602771:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602777:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602783:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602788:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602794:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602800:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602818:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602826:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602832:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602837:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602842:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602848:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602853:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602857:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602863:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602868:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602874:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602890:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602897:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602903:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602908:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602913:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602918:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602923:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602928:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602933:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602938:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602943:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602949:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602954:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602959:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.602965:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432685.603959:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff94843c932400:8440] 0 exiting: rc = 1 00000100:00100000:3.0:1787432685.604497:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff94843c924c00:8441] 1 exiting: rc = 0 00000100:00100000:0.0:1787432685.604625:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604632:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604651:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604657:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604663:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604671:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604676:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604682:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604703:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604709:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604715:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604721:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604727:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604733:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604738:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604743:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604749:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604755:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604763:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604771:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604792:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604800:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604805:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604811:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604818:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604824:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604830:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604836:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604842:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604848:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604853:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604860:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604891:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604900:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604907:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604913:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604920:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604932:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604937:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604945:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604950:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604956:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604962:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604967:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604987:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604993:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.604999:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.605006:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.605012:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.605017:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.605023:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.605028:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.605034:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.605040:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.605045:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.605051:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.605070:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.605075:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.605080:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.605086:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.605091:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.605096:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.605102:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432685.605107:0:15769:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787432685.629944:0:15769:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787432709.824691:0:16533:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787432721.361900:0:17133:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787432721.361906:0:17133:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1787432721.361907:0:17133:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787432721.362013:0:17133:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9483038e1000 00000020:01000004:0.0:1787432721.362029:0:17133:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787432721.362037:0:17133:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787432721.362052:0:17133:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9484336199b8) 00000020:00000080:0.0:1787432721.362076:0:17133:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787432721.452688:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787432721.453652:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787432721.464302:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787432721.464640:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787432721.464979:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787432721.466156:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787432721.466674:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787432721.466930:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787432721.467299:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787432721.467736:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787432721.468000:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787432721.468761:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787432721.469122:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787432721.469660:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787432721.470668:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1787432721.470918:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787432721.471379:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1787432721.471639:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1787432721.471848:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787432721.472301:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1787432721.472840:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1787432721.473159:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787432721.474277:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787432721.474711:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1787432721.474916:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787432721.475308:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787432721.475915:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1787432721.476412:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787432721.476618:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1787432721.476813:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1787432721.480635:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1787432721.480966:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1787432721.481825:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1787432721.482408:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1787432721.485614:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1787432721.485954:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787432721.486837:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1787432721.487381:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1787432721.488019:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787432721.488412:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787432721.488826:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787432721.489097:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1787432721.489470:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787432721.490071:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787432721.490711:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787432721.491291:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787432721.496637:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1787432721.498241:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1787432721.498991:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1787432721.499552:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1787432721.500275:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1787432721.500793:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1787432721.503868:0:17133:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:1.0:1787432721.505684:0:17133:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787432721.505998:0:17133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787432721.506006:0:17133:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787432721.506552:0:17133:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33563fc44 00000020:01000004:1.0:1787432721.506564:0:17133:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1787432721.506569:0:17133:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787432721.506576:0:17133:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9483038e1000 from MGS 00000020:01000004:1.0:1787432721.506579:0:17133:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787432721.506590:0:17133:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9483031a99b8) 00000020:00000080:1.0:1787432721.506601:0:17133:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787432721.506666:0:17133:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9483038e1000 from MGS, refs=2 00080000:01000000:1.0:1787432721.506672:0:17133:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787432721.506677:0:17133:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33563fc52 00000100:00100000:1.0:1787432721.507290:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787432721.507426:0:17133:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787432721.507433:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787432721.508632:0:17133:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787432721.508644:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787432721.509596:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432721.512318:0:17133:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787432721.512330:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787432721.515592:0:17133:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787432721.515609:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787432721.516112:0:17133:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787432721.516119:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787432721.516866:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432721.516871:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432721.516873:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432721.517601:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432721.517604:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432721.517606:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432721.518380:0:17133:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787432721.519341:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787432721.558933:0:17133:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787432721.565548:0:17145:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787432721.565995:0:17133:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787432721.566071:0:17133:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787432721.567233:0:17133:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787432721.567624:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432721.567783:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787432721.567789:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787432721.576034:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787432721.576051:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787432721.581473:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787432721.581624:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787432721.601706:0:17133:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787432721.601744:0:17133:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.124@tcp' 00000020:01000004:3.0:1787432721.601746:0:17133:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787432721.601776:0:17133:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.124@tcp (typ=mgc) 00000020:00000080:3.0:1787432721.601790:0:17133:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.124@tcp (ffff9483030f0000) 00000020:00000080:3.0:1787432721.601805:0:17133:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787432721.601892:0:17133:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948409d2d800@MGC192.168.204.124@tcp: add connection 192.168.204.124@tcp at head 00010000:00010000:3.0:1787432721.602043:0:17133:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.124@tcp-0 is initialized 00000040:01000000:3.0:1787432721.602049:0:17133:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.124@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787432721.605367:0:17150:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787432721.606088:0:17151:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787432721.606217:0:17133:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.124@tcp (uuid a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b) 00000020:00000080:3.0:1787432721.606242:0:17133:0:(genops.c:1385:class_connect()) connect: client a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b, cookie 0xca72b3b33563fc60 00000100:00080000:3.0:1787432721.606255:0:17133:0:(import.c:510:import_select_connection()) MGC192.168.204.124@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787432721.606261:0:17133:0:(import.c:624:import_select_connection()) MGC192.168.204.124@tcp: import ffff948409d2d800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432721.606307:0:17133:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948303798e00 x1874258609478144/t0(0) o250->MGC192.168.204.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432721.606330:0:17133:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b->MGS 00000020:01000004:3.0:1787432721.606348:0:17133:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787432721.606353:0:17133:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787432721.606367:0:17133:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9483030f3370) 00000020:00000080:3.0:1787432721.606380:0:17133:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787432721.609128:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3640:1874258609478144:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787432721.609235:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432721.609412:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609478144 00000100:00100000:0.0:1787432721.609420:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609478144 00000100:00100000:0.0:1787432721.609462:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432721.609471:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1874258609478144:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787432721.609497:0:17147:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b@0@lo t0 exp 0000000000000000 cur 532 last 0 00000020:00000080:0.0:1787432721.609524:0:17147:0:(genops.c:1385:class_connect()) connect: client a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b, cookie 0xca72b3b33563fc6e 00000100:00080000:0.0:1787432721.609657:0:17147:0:(import.c:65:import_set_state_nolock()) ffff94843c5ee000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432721.609713:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+5:3640:x1874258609478144:12345-0@lo:250:mount.lustre.0 Request processed in 241us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432721.609720:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432721.609763:0:3640:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.124@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787432721.609772:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.124@tcp: connect to target with instance 0 00000100:00080000:0.0:1787432721.609779:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.124@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787432721.609783:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787432721.609786:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948409d2d800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787432721.609789:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787432721.609799:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787432721.609805:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3640:1874258609478144:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787432721.630902:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432721.631067:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787432721.631073:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787432721.637785:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787432721.637797:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787432721.640854:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787432721.640867:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787432721.641558:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432721.641746:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787432721.641751:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787432721.642337:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787432721.642344:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787432721.688612:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787432721.688827:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787432721.688835:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787432721.690657:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787432721.690671:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787432721.691703:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787432721.692123:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787432721.692130:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787432721.692720:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787432721.692728:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787432721.693468:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787432721.693618:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787432721.693623:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787432721.695468:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787432721.695480:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787432721.697415:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432721.698830:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787432721.698840:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787432721.711461:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787432721.711480:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787432721.735465:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432721.735785:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787432721.735792:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787432721.737502:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787432721.737516:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787432721.738716:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787432721.738727:0:17133:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787432721.739736:0:17133:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787432721.739767:0:17133:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787432721.739773:0:17133:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.124@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787432721.739965:0:17133:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.124@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787432721.740005:0:17133:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.124@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787432721.740010:0:17133:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787432721.740012:0:17133:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787432721.740013:0:17133:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432721.740014:0:17133:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432721.740015:0:17133:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432721.740016:0:17133:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432721.740018:0:17133:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787432721.740019:0:17133:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787432721.740021:0:17133:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432721.740023:0:17133:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787432721.740026:0:17133:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787432721.740028:0:17133:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787432721.740029:0:17133:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787432721.740030:0:17133:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432721.740036:0:17133:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432721.740036:0:17133:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432721.740038:0:17133:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432721.740038:0:17133:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787432721.740039:0:17133:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787432721.740040:0:17133:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432721.740041:0:17133:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787432721.740067:0:17133:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787432721.740088:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609478272:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787432721.740160:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432721.740307:0:17133:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432721.740389:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609478272 00000100:00100000:1.0:1787432721.740397:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609478272 00000100:00100000:1.0:1787432721.740448:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787432721.740458:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+5:17133:x1874258609478272:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787432721.740505:0:17149:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787432721.740509:0:17149:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787432721.740512:0:17149:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787432721.741012:0:17170:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787432721.741992:0:17149:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1787432721.744092:0:17171:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787432721.744100:0:17171:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1787432721.744103:0:17171:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787432721.744106:0:17171:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787432721.744654:0:17171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1787432721.745397:0:17149:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787432721.745411:0:17149:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787432721.755488:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+5:17133:x1874258609478272:12345-0@lo:253:mount.lustre.0 Request processed in 15021us (15317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432721.755508:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787432721.756355:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609478272:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787432721.756372:0:17133:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787432721.756376:0:17133:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787432721.756377:0:17133:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787432721.756379:0:17133:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432721.756380:0:17133:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432721.756381:0:17133:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432721.756382:0:17133:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432721.756383:0:17133:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787432721.756385:0:17133:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787432721.756386:0:17133:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432721.756387:0:17133:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787432721.756415:0:17133:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9483038e1000 from lustre-MDT0000 10000000:01000000:3.0:1787432721.756516:0:17133:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787432721.756519:0:17133:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787432721.756524:0:17133:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9483030f0000 10000000:01000000:3.0:1787432721.756527:0:17133:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787432721.756536:0:17133:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9483030f0000 from 1 10000000:01000000:3.0:1787432721.756539:0:17133:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787432721.757144:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432721.757373:0:17133:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432721.757400:0:17133:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432721.757422:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609478400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787432721.757723:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432721.757810:0:17133:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d9540 going to sleep for 11 seconds 00000100:00100000:1.0:1787432721.758021:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609478400 00000100:00100000:1.0:1787432721.758029:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609478400 00000100:00100000:1.0:1787432721.758124:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432721.758134:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+5:17133:x1874258609478400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432721.758146:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432721.758216:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303851e00/0xca72b3b33563fc7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fc75 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432721.758241:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303851e00/0xca72b3b33563fc7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fc75 expref: 6 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432721.758252:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303851e00/0xca72b3b33563fc7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fc75 expref: 6 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432721.758261:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851e00, rc 0) 00000100:00100000:1.0:1787432721.758308:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+6:17133:x1874258609478400:12345-0@lo:101:mount.lustre.0 Request processed in 176us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432721.758314:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787432721.758451:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609478400:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432721.758467:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432721.758476:0:17133:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fc7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432721.758564:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609478528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432721.758592:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432721.759427:0:17133:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d9540 going to sleep for 11 seconds 00000100:00100000:2.0:1787432721.759668:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609478528 00000100:00100000:2.0:1787432721.759675:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609478528 00000100:00100000:2.0:1787432721.759713:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787432721.759723:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+6:17133:x1874258609478528:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432721.760026:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+6:17133:x1874258609478528:12345-0@lo:501:mount.lustre.0 Request processed in 303us (1431us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787432721.760035:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432721.760135:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609478528:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787432721.760352:0:17133:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787432721.760374:0:17133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432721.760383:0:17133:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432721.760392:0:17133:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9483038e1000 10000000:01000000:3.0:1787432721.760414:0:17133:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787432721.760425:0:17133:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9483038e1000 10000000:01000000:3.0:1787432721.760428:0:17133:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787432721.760432:0:17133:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9483038e1000 from 1 10000000:01000000:3.0:1787432721.760435:0:17133:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787432721.760638:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f0400/0xca72b3b33563fc83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432721.760646:0:17133:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9483039f0400/0xca72b3b33563fc83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432721.760655:0:17133:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9483039f0400/0xca72b3b33563fc83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432721.760673:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609478656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787432721.760722:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432721.760751:0:17133:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483024d9540 going to sleep for 11 seconds 00000100:00100000:1.0:1787432721.760796:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609478656 00000100:00100000:1.0:1787432721.760813:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609478656 00000100:00100000:1.0:1787432721.760853:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787432721.761075:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948418e9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+6:17133:x1874258609478656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432721.761088:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432721.761102:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303851000/0xca72b3b33563fc8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fc83 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432721.761121:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303851000/0xca72b3b33563fc8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fc83 expref: 7 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432721.761142:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303851000/0xca72b3b33563fc8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fc83 expref: 7 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432721.761150:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851000, rc 0) 00000100:00100000:1.0:1787432721.761375:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948418e9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+7:17133:x1874258609478656:12345-0@lo:101:mount.lustre.0 Request processed in 513us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432721.761382:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787432721.762004:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609478656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432721.762023:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9483039f0400/0xca72b3b33563fc83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432721.762034:0:17133:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9483039f0400/0xca72b3b33563fc83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fc8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432721.762050:0:17133:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787432721.762104:0:17133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f0400/0xca72b3b33563fc83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432721.762112:0:17133:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9483039f0400/0xca72b3b33563fc83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432721.762133:0:17133:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787432721.762361:0:17133:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787432721.762369:0:17133:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9483038e1000 10000000:01000000:0.0:1787432721.762372:0:17133:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787432721.762376:0:17133:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787432721.762379:0:17133:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787432721.762407:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489400/0xca72b3b33563fc91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432721.762416:0:17133:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948304489400/0xca72b3b33563fc91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432721.762424:0:17133:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948304489400/0xca72b3b33563fc91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432721.762514:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609478784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787432721.762631:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432721.762751:0:17133:0:(client.c:2715:ptlrpc_set_wait()) set ffff948409846a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432721.763025:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609478784 00000100:00100000:2.0:1787432721.763035:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609478784 00000100:00100000:2.0:1787432721.763124:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432721.763135:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948418e9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+7:17133:x1874258609478784:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432721.763146:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432721.763209:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484032e5200/0xca72b3b33563fc98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fc91 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432721.763232:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e5200/0xca72b3b33563fc98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fc91 expref: 8 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432721.763241:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484032e5200/0xca72b3b33563fc98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fc91 expref: 8 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432721.763249:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e5200, rc 0) 00000100:00100000:2.0:1787432721.763295:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948418e9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+8:17133:x1874258609478784:12345-0@lo:101:mount.lustre.0 Request processed in 162us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432721.763302:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787432721.763388:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609478784:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432721.763402:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948304489400/0xca72b3b33563fc91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc98 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432721.763410:0:17133:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948304489400/0xca72b3b33563fc91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fc98 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432721.763732:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609478912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432721.763767:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432721.764108:0:17133:0:(client.c:2715:ptlrpc_set_wait()) set ffff948433799cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432721.764364:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609478912 00000100:00100000:0.0:1787432721.764369:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609478912 00000100:00100000:0.0:1787432721.764404:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787432721.764413:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948418e9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+8:17133:x1874258609478912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432721.764765:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948418e9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+9:17133:x1874258609478912:12345-0@lo:501:mount.lustre.0 Request processed in 352us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432721.764774:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787432721.765070:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609478912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432721.765110:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609479040:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432721.765226:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432721.765264:0:17133:0:(client.c:2715:ptlrpc_set_wait()) set ffff948433799cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432721.765366:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609479040 00000100:00100000:0.0:1787432721.765371:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609479040 00000100:00100000:0.0:1787432721.765409:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787432721.765417:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948418e9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+9:17133:x1874258609479040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432721.766566:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948418e9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+9:17133:x1874258609479040:12345-0@lo:503:mount.lustre.0 Request processed in 1144us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432721.766577:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787432721.766740:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609479040:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432721.767473:0:17172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17172:1874258609479168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432721.767522:0:17172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432721.767576:0:17172:0:(client.c:2715:ptlrpc_set_wait()) set ffff948433799e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432721.767674:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609479168 00000100:00100000:2.0:1787432721.767680:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609479168 00000100:00100000:2.0:1787432721.767724:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787432721.767734:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948418e9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+9:17172:x1874258609479168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432721.769052:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948418e9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+9:17172:x1874258609479168:12345-0@lo:502:llog_process_th.0 Request processed in 1315us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432721.769062:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432721.769402:0:17172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17172:1874258609479168:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787432721.769437:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432721.769514:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432721.769518:0:17172:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787432721.769523:0:17172:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787432721.769526:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787432721.769542:0:17172:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9483031ab370) 00000020:00000080:1.0:1787432721.769619:0:17172:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787432721.769626:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787432721.769707:0:17172:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787432721.769715:0:17172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33563fca6 00000020:00000080:1.0:1787432721.770098:0:17172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787432721.770103:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432721.770107:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432721.770109:0:17172:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787432721.770111:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432721.770115:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432721.770116:0:17172:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787432721.770119:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787432721.770126:0:17172:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9483031a8000) 00000020:00000080:1.0:1787432721.770137:0:17172:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787432721.770140:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787432721.770142:0:17172:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787432721.770145:0:17172:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787432721.770151:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787432721.770352:0:17172:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9483038e1000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787432721.770366:0:17172:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9483031acd28) 00000020:00000080:1.0:1787432721.770374:0:17172:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787432721.770429:0:17172:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787432721.770435:0:17172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b33563fcbb 00000020:00000080:1.0:1787432721.770666:0:17172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787432721.770678:0:17172:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787432721.770683:0:17172:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xca72b3b33563fcc2 00080000:01000000:1.0:1787432721.770689:0:17172:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787432721.770692:0:17172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33563fcc9 00010000:00010000:2.0:1787432721.869148:0:17172:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787432721.872000:0:17172:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:2.0:1787432721.873555:0:17172:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787432721.875595:0:17172:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9484349d3370) 00000020:00000080:2.0:1787432721.875617:0:17172:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787432721.875736:0:17172:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787432721.875744:0:17172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33563fcd7 00000020:00000080:3.0:1787432721.880473:0:17172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787432721.890088:0:17172:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xca72b3b33563fcde 00000020:00000080:3.0:1787432721.891015:0:17172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787432721.891028:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432721.891037:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432721.891040:0:17172:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787432721.891043:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787432721.891046:0:17172:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1787432721.891048:0:17172:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787432721.891050:0:17172:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787432721.891051:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787432721.891053:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432721.891055:0:17172:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787432721.891057:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432721.891063:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432721.891064:0:17172:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787432721.891069:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787432721.891110:0:17172:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787432721.891126:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432721.891129:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432721.891131:0:17172:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787432721.891133:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432721.891136:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432721.891137:0:17172:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1787432721.891140:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787432721.891145:0:17172:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.124@tcp to nid 0x20000c0a8cc7c (192.168.204.124@tcp) 00000020:00000080:3.0:1787432721.891203:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787432721.891222:0:17172:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9483030f19b8) 00000020:00000080:3.0:1787432721.891239:0:17172:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787432721.891245:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787432721.891314:0:17172:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1787432721.891320:0:17172:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787432721.891327:0:17172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33563fcec 00010000:00080000:3.0:1787432721.891361:0:17172:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948409d2f000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.124@tcp at head 00010000:00010000:3.0:1787432721.898320:0:17172:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1787432721.900414:0:17172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787432721.900431:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787432721.900475:0:17172:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787432721.900497:0:17172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b33563fcf3 00000100:00080000:2.0:1787432721.900509:0:17172:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787432721.900514:0:17172:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff948409d2f000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432721.900561:0:17172:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9484348dd500 x1874258609479296/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432721.900586:0:17172:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1787432721.900644:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432721.900648:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432721.900649:0:17172:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1787432721.900652:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787432721.900655:0:17172:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1787432721.900657:0:17172:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787432721.900658:0:17172:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787432721.900660:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787432721.900662:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432721.900663:0:17172:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787432721.900666:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787432721.900670:0:17172:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787432721.900673:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432721.900674:0:17172:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787432721.900677:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787432721.900681:0:17172:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.124@tcp to nid 0x20000c0a8cc7c (192.168.204.124@tcp) 00000020:01000000:2.0:1787432721.900706:0:17172:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787432721.900708:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787432721.900728:0:17172:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9484349d4d28) 00000020:00000080:2.0:1787432721.900739:0:17172:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787432721.900745:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787432721.900800:0:17172:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787432721.900806:0:17172:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787432721.900813:0:17172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33563fd01 00010000:00080000:2.0:1787432721.900842:0:17172:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9484166d0800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.124@tcp at head 00010000:00010000:2.0:1787432721.901127:0:17172:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1787432721.903011:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609479296:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787432721.903095:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432721.903262:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609479296 00000100:00100000:3.0:1787432721.903270:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609479296 00000100:00100000:3.0:1787432721.903317:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432721.903324:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874258609479296:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1787432721.903342:0:17159:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1787432721.905668:0:17172:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787432721.907718:0:17172:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787432721.918161:0:17172:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787432721.918589:0:17172:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787432721.932685:0:17172:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:3.0:1787432721.934719:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874258609479296:12345-0@lo:38:llog_process_th.0 Request processed in 31106us (31336us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787432721.934735:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787432721.934828:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948409d2f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787432721.934833:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787432721.934837:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609479296:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787432721.935992:0:17178:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787432721.935998:0:17178:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787432721.937416:0:17172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787432721.937430:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787432721.937635:0:17172:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787432721.937657:0:17172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b33563fd08 00000100:00080000:1.0:1787432721.937667:0:17172:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787432721.937673:0:17172:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9484166d0800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432721.937707:0:17172:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948304646680 x1874258609479424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787432721.937731:0:17172:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787432721.937783:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432721.937787:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432721.937789:0:17172:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787432721.937792:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787432721.937795:0:17172:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000100:00080000:2.0:1787432721.937941:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787432721.937946:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787432721.937948:0:8:0:(import.c:65:import_set_state_nolock()) ffff948409d2f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432721.937952:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 532 00000100:00080000:2.0:1787432721.937957:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787432721.937960:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff948409d2f000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432721.937974:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9484348df480 x1874258609479680/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787432721.938016:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609479552:0@lo:400:kworker.0 00000100:00100000:2.0:1787432721.938081:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432721.938132:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609479552 00000100:00100000:2.0:1787432721.938137:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609479552 00000100:00100000:2.0:1787432721.938201:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787432721.938211:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948418e9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+9:3642:x1874258609479552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432721.938262:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948418e9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+9:3642:x1874258609479552:12345-0@lo:400:kworker.0 Request processed in 52us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432721.938269:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787432721.938334:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609479552:0@lo:400:kworker.0 00000020:01000000:1.0:1787432721.938521:0:17172:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787432721.938524:0:17172:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787432721.938526:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787432721.938531:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432721.938533:0:17172:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787432721.938537:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787432721.938558:0:17172:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787432721.938563:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432721.938564:0:17172:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787432721.938568:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787432721.938572:0:17172:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.124@tcp to nid 0x20000c0a8cc7c (192.168.204.124@tcp) 00000020:01000000:1.0:1787432721.938592:0:17172:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787432721.938595:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787432721.938608:0:17172:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff94841de9b370) 00000020:00000080:1.0:1787432721.938621:0:17172:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787432721.938626:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787432721.938711:0:17172:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787432721.938717:0:17172:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787432721.938724:0:17172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xca72b3b33563fd16 00010000:00080000:1.0:1787432721.938751:0:17172:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9484034a6800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.124@tcp at head 00010000:00010000:1.0:1787432721.939018:0:17172:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787432721.939083:0:17172:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787432721.939098:0:17172:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1787432721.943474:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304646680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609479424:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787432721.943563:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258609479424 offset 0 length 520: 4 00000100:00100000:2.0:1787432721.943603:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609479680:0@lo:38:kworker.0 00000100:00100000:2.0:1787432721.943635:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432721.943688:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609479680 00000100:00100000:2.0:1787432721.943695:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609479680 00000100:00100000:2.0:1787432721.943724:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432721.943732:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609479680:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787432721.943751:0:17160:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787432721.943791:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609479680:12345-0@lo:38:kworker.0 Request processed in 59us (155us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787432721.943809:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787432721.943845:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948409d2f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787432721.943850:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787432721.943853:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609479680:0@lo:38:kworker.0 00000040:00080000:1.0:1787432721.946406:0:17172:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787432721.947795:0:17172:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787432721.948138:0:17172:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787432721.950616:0:17180:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787432721.950623:0:17180:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787432721.951636:0:17172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787432721.951648:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787432721.951686:0:17172:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787432721.951705:0:17172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b33563fd1d 00000100:00080000:1.0:1787432721.951715:0:17172:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787432721.951721:0:17172:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9484034a6800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432721.951753:0:17172:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948304647100 x1874258609479808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787432721.951825:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609479808:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787432721.951886:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258609479808 offset 0 length 520: 4 00000100:00080000:1.0:1787432721.951999:0:17172:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787432721.952056:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432721.952068:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432721.952071:0:17172:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787432721.952074:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432721.952078:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432721.952080:0:17172:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787432721.952083:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787432721.952085:0:17172:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787432721.952087:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432721.952089:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432721.952090:0:17172:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787432721.952092:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432721.952094:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432721.952095:0:17172:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787432721.952098:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787432721.952128:0:17172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17172:1874258609479936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432721.952217:0:17172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432721.952248:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609479936 00000100:00100000:1.0:1787432721.952256:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609479936 00000100:00100000:1.0:1787432721.952295:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787432721.952303:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+9:17172:x1874258609479936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432721.952412:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+9:17172:x1874258609479936:12345-0@lo:502:llog_process_th.0 Request processed in 110us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432721.952419:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787432721.952457:0:17172:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bbe840 going to sleep for 11 seconds 00000100:00100000:1.0:1787432721.952474:0:17172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17172:1874258609479936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787432721.952498:0:17172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432721.952501:0:17172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432721.952502:0:17172:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787432721.952505:0:17172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787432721.952783:0:17133:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1787432721.952814:0:17133:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787432721.952833:0:17133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489400/0xca72b3b33563fc91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc98 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432721.952843:0:17133:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948304489400/0xca72b3b33563fc91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc98 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432721.952851:0:17133:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9483038e1000 from 1 10000000:01000000:0.0:1787432721.952854:0:17133:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787432721.952892:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563fd24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432721.952900:0:17133:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563fd24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432721.952908:0:17133:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563fd24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432721.952922:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609480064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787432721.952953:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432721.952975:0:17133:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037ea3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432721.953304:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609480064 00000100:00100000:3.0:1787432721.953309:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609480064 00000100:00100000:3.0:1787432721.953351:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787432721.953360:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+9:17133:x1874258609480064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432721.953370:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432721.953386:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9483039f0800/0xca72b3b33563fd2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fd24 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432721.953405:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9483039f0800/0xca72b3b33563fd2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fd24 expref: 10 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432721.953424:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9483039f0800/0xca72b3b33563fd2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fd24 expref: 10 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432721.953432:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f0800, rc 0) 00000100:00100000:3.0:1787432721.953467:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+10:17133:x1874258609480064:12345-0@lo:101:mount.lustre.0 Request processed in 109us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432721.953473:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787432721.953561:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609480064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432721.953573:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563fd24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432721.953591:0:17133:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563fd24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fd2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432721.954417:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609480192:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787432721.954464:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432721.954504:0:17133:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037ea3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432721.954586:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609480192 00000100:00100000:3.0:1787432721.954592:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609480192 00000100:00100000:3.0:1787432721.954635:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787432721.954645:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+10:17133:x1874258609480192:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787432721.954662:0:17147:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787432721.954667:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787432721.954739:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+10:17133:x1874258609480192:12345-0@lo:256:mount.lustre.0 Request processed in 96us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432721.954746:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787432721.955666:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609480192:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787432721.956387:0:17133:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787432721.956414:0:17133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563fd24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432721.956426:0:17133:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563fd24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432721.956434:0:17133:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9483038e1000 from 1 10000000:01000000:1.0:1787432721.956437:0:17133:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787432721.956472:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303851600/0xca72b3b33563fd32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432721.956479:0:17133:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948303851600/0xca72b3b33563fd32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432721.956488:0:17133:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948303851600/0xca72b3b33563fd32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432721.956509:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609480320:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787432721.956985:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432721.957028:0:17133:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bbe840 going to sleep for 11 seconds 00000100:00100000:3.0:1787432721.957298:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609480320 00000100:00100000:3.0:1787432721.957307:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609480320 00000100:00100000:3.0:1787432721.957355:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787432721.957363:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+10:17133:x1874258609480320:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432721.957375:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432721.957391:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9483039f0200/0xca72b3b33563fd39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fd32 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432721.957413:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9483039f0200/0xca72b3b33563fd39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fd32 expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432721.957439:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9483039f0200/0xca72b3b33563fd39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fd32 expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432721.957447:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f0200, rc 0) 00000100:00100000:3.0:1787432721.957501:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+11:17133:x1874258609480320:12345-0@lo:101:mount.lustre.0 Request processed in 138us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432721.957507:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432721.957656:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609480320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432721.957670:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948303851600/0xca72b3b33563fd32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432721.957678:0:17133:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948303851600/0xca72b3b33563fd32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fd39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432721.957759:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609480448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432721.957788:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432721.957825:0:17133:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335af000 going to sleep for 11 seconds 00000100:00100000:1.0:1787432721.958037:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609480448 00000100:00100000:1.0:1787432721.958042:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609480448 00000100:00100000:1.0:1787432721.958076:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787432721.958083:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+11:17133:x1874258609480448:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432721.958255:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+11:17133:x1874258609480448:12345-0@lo:501:mount.lustre.0 Request processed in 171us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432721.958262:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787432721.958352:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609480448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432721.958386:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609480576:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432721.958426:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432721.958453:0:17133:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037eae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432721.958517:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609480576 00000100:00100000:3.0:1787432721.958521:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609480576 00000100:00100000:3.0:1787432721.958541:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787432721.958559:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+11:17133:x1874258609480576:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787432721.958642:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+11:17133:x1874258609480576:12345-0@lo:503:mount.lustre.0 Request processed in 84us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432721.958648:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787432721.958792:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609480576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432721.959481:0:17182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304646300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17182:1874258609480704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432721.959531:0:17182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432721.959574:0:17182:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bbe9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432721.959677:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609480704 00000100:00100000:3.0:1787432721.959682:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609480704 00000100:00100000:3.0:1787432721.959720:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787432721.959728:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+11:17182:x1874258609480704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432721.960393:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+11:17182:x1874258609480704:12345-0@lo:502:llog_process_th.0 Request processed in 662us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432721.960403:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787432721.960695:0:17182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304646300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17182:1874258609480704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432721.960727:0:17182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432721.960736:0:17182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432721.960739:0:17182:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787432721.960747:0:17182:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9483038e1000 00000020:00000080:2.0:1787432721.960750:0:17182:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787432721.960758:0:17182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432721.960760:0:17182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432721.960761:0:17182:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787432721.960764:0:17182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432721.960766:0:17182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432721.960767:0:17182:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787432721.960771:0:17182:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9483038e1000 00000020:00000080:2.0:1787432721.960773:0:17182:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787432721.960989:0:17182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432721.960994:0:17182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432721.960995:0:17182:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787432721.960998:0:17182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432721.961000:0:17182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432721.961001:0:17182:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787432721.961005:0:17182:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9483038e1000 00000020:00000080:2.0:1787432721.961007:0:17182:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787432721.966765:0:17182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432721.966784:0:17182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432721.966787:0:17182:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787432721.966791:0:17182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432721.967724:0:17182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432721.967727:0:17182:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787432721.967735:0:17182:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9483038e1000 00000020:00000080:2.0:1787432721.967737:0:17182:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787432721.967847:0:17182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17182:1874258609480832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432721.968423:0:17182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432721.968538:0:17182:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335af480 going to sleep for 11 seconds 00000100:00100000:3.0:1787432721.979470:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609480832 00000100:00100000:3.0:1787432721.979485:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609480832 00000100:00100000:3.0:1787432721.979543:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787432721.979554:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+11:17182:x1874258609480832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432721.979727:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+11:17182:x1874258609480832:12345-0@lo:502:llog_process_th.0 Request processed in 174us (11304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432721.979741:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787432721.981015:0:17182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17182:1874258609480832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787432721.981064:0:17182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432721.981075:0:17182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432721.981077:0:17182:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787432721.981082:0:17182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787432721.981320:0:17133:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787432721.981347:0:17133:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787432721.981373:0:17133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303851600/0xca72b3b33563fd32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432721.981386:0:17133:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948303851600/0xca72b3b33563fd32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432721.981445:0:17133:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787432721.981448:0:17133:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9483038e1000 10000000:01000000:0.0:1787432721.981451:0:17133:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9483038e1000 10000000:01000000:0.0:1787432721.981455:0:17133:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787432721.981462:0:17133:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9483038e1000 from 1 10000000:01000000:0.0:1787432721.981464:0:17133:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787432721.981500:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489c00/0xca72b3b33563fd40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432721.981518:0:17133:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948304489c00/0xca72b3b33563fd40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432721.981528:0:17133:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948304489c00/0xca72b3b33563fd40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432721.981550:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609480960:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787432721.981617:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432721.981652:0:17133:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037eab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432721.983965:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609480960 00000100:00100000:1.0:1787432721.983979:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609480960 00000100:00100000:1.0:1787432721.984046:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787432721.984058:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+11:17133:x1874258609480960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432721.984077:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432721.984096:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303850400/0xca72b3b33563fd47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fd40 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432721.984126:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303850400/0xca72b3b33563fd47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fd40 expref: 12 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432721.984138:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303850400/0xca72b3b33563fd47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fd40 expref: 12 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432721.984147:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850400, rc 0) 00000100:00100000:1.0:1787432721.984257:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17133:x1874258609480960:12345-0@lo:101:mount.lustre.0 Request processed in 201us (2640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432721.984264:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787432721.985005:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609480960:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432721.985028:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948304489c00/0xca72b3b33563fd40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd47 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432721.985038:0:17133:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948304489c00/0xca72b3b33563fd40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fd47 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432721.985121:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609481088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432721.985192:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432721.985224:0:17133:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037eab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432721.985995:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609481088 00000100:00100000:3.0:1787432721.986003:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609481088 00000100:00100000:3.0:1787432721.986049:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787432721.986058:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17133:x1874258609481088:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432721.986234:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17133:x1874258609481088:12345-0@lo:501:mount.lustre.0 Request processed in 176us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432721.986242:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787432721.987458:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609481088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432721.987517:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609481216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432721.987577:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432721.987670:0:17133:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037eab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432721.992936:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609481216 00000100:00100000:3.0:1787432721.992953:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609481216 00000100:00100000:3.0:1787432721.993006:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787432721.993017:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17133:x1874258609481216:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787432721.993190:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17133:x1874258609481216:12345-0@lo:503:mount.lustre.0 Request processed in 174us (5612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432721.993198:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787432721.994080:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609481216:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432721.997336:0:17187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17187:1874258609481344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432721.997420:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432721.997476:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609481344 00000100:00100000:1.0:1787432721.997483:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609481344 00000100:00100000:1.0:1787432721.997523:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787432721.997532:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17187:x1874258609481344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432721.997644:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17187:x1874258609481344:12345-0@lo:502:llog_process_th.0 Request processed in 113us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432721.997652:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787432721.997704:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841174f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787432721.997726:0:17187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17187:1874258609481344:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787432721.997784:0:17187:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787432721.997799:0:17187:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff94841de9cd28) 00000020:00000080:1.0:1787432721.997818:0:17187:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1787432721.998052:0:17187:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9483038e1000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787432721.998057:0:17187:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9483038e1000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787432721.998059:0:17187:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9483038e1000 4 00010000:00080000:1.0:1787432721.998088:0:17187:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9484122e1800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.124@tcp at head 00010000:00010000:1.0:1787432722.001774:0:17187:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1787432722.005228:0:17187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787432722.005295:0:17187:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787432722.005309:0:17187:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xca72b3b33563fd55 00000100:00080000:0.0:1787432722.005320:0:17187:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787432722.005326:0:17187:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9484122e1800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432722.005358:0:17187:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94830390bb80 x1874258609481472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432722.005388:0:17187:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787432722.005730:0:17187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17187:1874258609481600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432722.005798:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432722.005830:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609481600 00000100:00100000:0.0:1787432722.005836:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609481600 00000100:00100000:2.0:1787432722.006111:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874258609481472:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787432722.006146:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432722.007041:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787432722.007055:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17187:x1874258609481600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432722.007204:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17187:x1874258609481600:12345-0@lo:502:llog_process_th.0 Request processed in 153us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432722.007212:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787432722.009552:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609481472 00000100:00100000:0.0:1787432722.009567:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609481472 00000100:00100000:0.0:1787432722.009652:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432722.009662:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874258609481472:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787432722.009759:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874258609481472:12345-0@lo:38:llog_process_th.0 Request processed in 97us (3612us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787432722.009765:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787432722.009831:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787432722.009839:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484122e1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787432722.009843:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787432722.009847:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874258609481472:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787432722.010856:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037eab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432722.010901:0:17187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17187:1874258609481600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432722.010970:0:17187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17187:1874258609481728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432722.011031:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432722.011064:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037eab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432722.011203:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609481728 00000100:00100000:3.0:1787432722.011209:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609481728 00000100:00100000:3.0:1787432722.011259:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787432722.011268:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17187:x1874258609481728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432722.011396:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17187:x1874258609481728:12345-0@lo:502:llog_process_th.0 Request processed in 128us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432722.011404:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787432722.014034:0:17187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17187:1874258609481728:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787432722.014085:0:17187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787432722.014326:0:17133:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787432722.014352:0:17133:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787432722.014371:0:17133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489c00/0xca72b3b33563fd40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd47 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432722.014400:0:17133:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948304489c00/0xca72b3b33563fd40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd47 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787432722.014451:0:17133:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787432722.014453:0:17133:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787432722.014455:0:17133:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432722.014456:0:17133:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432722.014457:0:17133:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432722.014458:0:17133:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432722.014460:0:17133:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787432722.014461:0:17133:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787432722.014463:0:17133:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432722.014464:0:17133:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787432722.014467:0:17133:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787432722.014470:0:17133:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787432722.014471:0:17133:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787432722.014472:0:17133:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432722.014473:0:17133:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432722.014474:0:17133:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432722.014475:0:17133:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432722.014475:0:17133:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787432722.014476:0:17133:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787432722.014477:0:17133:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432722.014478:0:17133:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787432722.014501:0:17133:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787432722.014518:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609481856:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787432722.014586:0:17133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432722.014621:0:17133:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037eaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432722.015381:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609481856 00000100:00100000:0.0:1787432722.015389:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609481856 00000100:00100000:0.0:1787432722.015432:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787432722.015441:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17133:x1874258609481856:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787432722.015476:0:17148:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787432722.015489:0:17148:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787432722.019149:0:17148:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787432722.019198:0:17148:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787432722.022489:0:17170:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787432722.022500:0:17170:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787432722.022522:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9483039f0e00/0xca72b3b33563fd5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432722.022552:0:17170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9483039f0800/0xca72b3b33563fd2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fd24 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432722.022561:0:17170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9483039f0e00/0xca72b3b33563fd5c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432722.022600:0:17170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9483039f0800/0xca72b3b33563fd2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563fd24 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432722.022616:0:17170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9483039f0800/0xca72b3b33563fd2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563fd24 expref: 12 pid: 17147 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432722.022631:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17170:1874258609481984:0@lo:104: 00000100:00100000:3.0:1787432722.022668:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432722.022709:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112df0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432722.022752:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609481984 00000100:00100000:3.0:1787432722.022758:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609481984 00000100:00100000:0.0:1787432722.023020:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17133:x1874258609481856:12345-0@lo:253:mount.lustre.0 Request processed in 7577us (8430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432722.023032:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787432722.023337:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17133:1874258609481856:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787432722.023350:0:17133:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787432722.023354:0:17133:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787432722.023355:0:17133:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787432722.023357:0:17133:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432722.023365:0:17133:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432722.023367:0:17133:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432722.023368:0:17133:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432722.023370:0:17133:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787432722.023371:0:17133:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787432722.023373:0:17133:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432722.023375:0:17133:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787432722.023389:0:17133:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787432722.024976:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432722.024999:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+3:17170:x1874258609481984:12345-0@lo:104: 00010000:00010000:3.0:1787432722.025019:0:17137:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563fd24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563fd2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432722.025117:0:17137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787432722.025124:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+3:17170:x1874258609481984:12345-0@lo:104: Request processed in 137us (2455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432722.025131:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787432722.025187:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432722.025193:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563fd24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563fd2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432722.025214:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489200 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1787432722.025218:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563fd24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563fd2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432722.025228:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563fd24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563fd2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432722.025236:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563fd24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563fd2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432722.025242:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787432722.025288:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563fd24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fd2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432722.025295:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787432722.025314:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563fd24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fd2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432722.025320:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563fd24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fd2b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432722.025339:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432722.025341:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432722.025342:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432722.025449:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609482112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432722.025488:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432722.025540:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609482112 00000100:00100000:0.0:1787432722.025547:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609482112 00010000:00010000:0.0:1787432722.025570:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9483039f0800/0xca72b3b33563fd2b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fd24 expref: 12 pid: 17147 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432722.025601:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432722.025609:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:3643:x1874258609482112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432722.025618:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432722.025623:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9483039f0800/0xca72b3b33563fd2b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fd24 expref: 12 pid: 17147 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432722.025633:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9483039f0800/0xca72b3b33563fd2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563fd24 expref: 12 pid: 17147 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432722.025649:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9483039f0e00/0xca72b3b33563fd5c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432722.025658:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9483039f0e00/0xca72b3b33563fd5c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787432722.025671:0:17139:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003171924s 00010000:00010000:0.0:1787432722.025682:0:17139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9483039f0e00/0xca72b3b33563fd5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432722.025688:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9483039f0e00/0xca72b3b33563fd5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432722.025695:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9483039f0e00/0xca72b3b33563fd5c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432722.025700:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9483039f0e00/0xca72b3b33563fd5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432722.025705:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0e00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432722.025708:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9483039f0e00/0xca72b3b33563fd5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432722.025714:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9483039f0e00/0xca72b3b33563fd5c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432722.025723:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9483039f0e00/0xca72b3b33563fd5c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432722.025732:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432722.025761:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:3643:x1874258609482112:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432722.025768:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432722.025805:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609482112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432722.025839:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9483039f0800/0xca72b3b33563fd2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563fd24 expref: 11 pid: 17147 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432722.025850:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17170:1874258609481984:0@lo:104: 00010000:00010000:0.0:1787432722.025875:0:17170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9483039f0e00/0xca72b3b33563fd5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432722.025884:0:17170:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9483039f0e00/0xca72b3b33563fd5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432722.025890:0:17170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9483039f0e00/0xca72b3b33563fd5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432722.025896:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9483039f0e00/0xca72b3b33563fd5c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787432722.049098:0:17133:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787432722.051609:0:17133:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787432722.052269:0:17194:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787432722.052596:0:17133:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1787432722.054510:0:17194:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432722.056501:0:17194:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787432722.056583:0:17194:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:2.0:1787432722.056924:0:17195:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9484348dce00 x1874258609482240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432722.056937:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00000040:01000000:0.0:1787432722.059749:0:17133:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787432722.059797:0:17133:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1787432722.060001:0:17193:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787432722.060007:0:17193:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:0.0:1787432722.062423:0:17133:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787432722.062443:0:17133:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787432722.062529:0:17133:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432722.065624:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787432722.066626:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787432722.066679:0:17133:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1787432722.069668:0:17133:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1787432722.074490:0:17133:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787432722.082548:0:17133:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787432722.082599:0:17133:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb0c1c0d1f988 00100000:10000000:1.0:1787432722.082608:0:17133:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787432722.083207:0:17133:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787432722.083224:0:17133:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.124@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787432722.083247:0:17133:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787432722.083272:0:17133:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1787432722.087308:0:17133:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787432722.087544:0:17133:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787432722.572459:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787432722.699270:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787432722.699278:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9483038e1000 from 7 10000000:01000000:0.0:1787432722.699288:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787432722.699330:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489800/0xca72b3b33563fd63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432722.699342:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948304489800/0xca72b3b33563fd63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432722.699354:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948304489800/0xca72b3b33563fd63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432722.699377:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609482368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787432722.699621:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432722.700438:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358e1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432722.700825:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609482368 00000100:00100000:1.0:1787432722.700836:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609482368 00000100:00100000:1.0:1787432722.700964:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787432722.700975:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+11:17151:x1874258609482368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432722.700990:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432722.701009:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303850200/0xca72b3b33563fd6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fd63 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432722.701033:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303850200/0xca72b3b33563fd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fd63 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432722.701043:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303850200/0xca72b3b33563fd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fd63 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432722.701052:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850200, rc 0) 00000100:00100000:1.0:1787432722.701194:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17151:x1874258609482368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (1572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432722.701201:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787432722.703362:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609482368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432722.703414:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948304489800/0xca72b3b33563fd63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd6a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432722.703427:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948304489800/0xca72b3b33563fd63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fd6a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432722.703602:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303799500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609482496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787432722.703662:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432722.703791:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609482496 00000100:00100000:1.0:1787432722.703797:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609482496 00000100:00100000:1.0:1787432722.703854:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787432722.703864:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17151:x1874258609482496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787432722.703884:0:17148:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787432722.703901:0:17148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787432722.703904:0:17148:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787432722.703984:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17151:x1874258609482496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432722.703993:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432722.704267:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112df3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432722.704284:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303799500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609482496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787432722.704338:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787432722.704346:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489800/0xca72b3b33563fd63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd6a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432722.704355:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948304489800/0xca72b3b33563fd63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd6a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787432723.022702:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787432723.085502:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00010000:00010000:3.0:1787432723.598672:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787432724.045395:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787432724.108936:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00010000:00010000:1.0:1787432724.625859:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432725.138866:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00010000:00010000:3.0:1787432725.645944:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432726.155898:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00010000:00010000:1.0:1787432726.667490:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787432727.120660:0:17438:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787432727.179956:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00000100:00080000:1.0:1787432727.500631:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787432727.500638:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787432727.500642:0:36:0:(import.c:65:import_set_state_nolock()) ffff948409d2f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787432727.500650:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 533 00000100:00080000:1.0:1787432727.500656:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787432727.500662:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff948409d2f000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432727.500685:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948304645180 x1874258609482752/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787432727.500704:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787432727.500707:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787432727.500710:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787432727.500713:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787432727.500715:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787432727.500726:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787432727.500728:0:36:0:(import.c:65:import_set_state_nolock()) ffff9484122e1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787432727.500733:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9484122e1800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432727.500746:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948304644000 x1874258609482880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787432727.500783:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432727.500797:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609482624:0@lo:400:kworker.0 00000100:00100000:1.0:1787432727.500868:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432727.500925:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609482752:0@lo:38:kworker.0 00000100:00100000:1.0:1787432727.500952:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432727.500970:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874258609482880:0@lo:38:kworker.0 00000100:00100000:1.0:1787432727.500994:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432727.501025:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609482624 00000100:00100000:1.0:1787432727.501031:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609482624 00000100:00100000:1.0:1787432727.501085:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787432727.501095:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:3643:x1874258609482624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432727.501142:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:3643:x1874258609482624:12345-0@lo:400:kworker.0 Request processed in 48us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432727.501149:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787432727.501207:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609482752 00000100:00100000:1.0:1787432727.501212:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609482752 00000100:00100000:1.0:1787432727.501230:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432727.501234:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609482752:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787432727.501249:0:17160:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787432727.505245:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609482880 00000100:00100000:0.0:1787432727.505255:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609482880 00000100:00100000:0.0:1787432727.505298:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432727.505307:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1874258609482880:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787432727.505335:0:17156:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:0.0:1787432727.505372:0:17156:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xca72b3b33563fd71 00000004:00100000:0.0:1787432727.505389:0:17156:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787432727.505513:0:17156:0:(import.c:65:import_set_state_nolock()) ffff948434b72000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432727.505595:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874258609482880:12345-0@lo:38:kworker.0 Request processed in 286us (4598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432727.505603:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432727.506909:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609482624:0@lo:400:kworker.0 00010000:00080000:0.0:1787432727.508909:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff948304644000 x1874258609482880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787432727.508943:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787432727.508953:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787432727.508960:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787432727.508963:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484122e1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787432727.508971:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874258609482880:0@lo:38:kworker.0 00000100:00100000:0.0:1787432727.546269:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609482752:12345-0@lo:38:kworker.0 Request processed in 45025us (45308us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787432727.546353:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787432727.546415:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948409d2f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432727.546421:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787432727.546425:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609482752:0@lo:38:kworker.0 00010000:00010000:3.0:1787432727.692406:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432728.207212:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00000020:00000004:0.0:1787432728.336519:0:17490:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787432728.338717:0:17490:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787432728.715749:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432729.227251:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00000020:00000004:3.0:1787432729.360249:0:17540:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432729.360427:0:17540:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787432729.739330:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432730.253779:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787432730.765396:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432731.275412:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00000100:00100000:1.0:1787432731.597809:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432721/real 1787432721] req@ffff948304647100 x1874258609479808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432731 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432731.597840:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948304647100 x1874258609479808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432731 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432731.597850:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432721/real 1787432721] req@ffff948304646680 x1874258609479424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432731 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432731.597861:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948304646680 x1874258609479424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432731 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787432731.597880:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484034a6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432731.597895:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787432731.597899:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609479808:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787432731.597905:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484166d0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432731.597909:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787432731.597912:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304646680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609479424:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787432731.600661:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787432731.600678:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787432731.600682:0:8:0:(import.c:65:import_set_state_nolock()) ffff948409d2f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432731.600690:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 538 00000100:00080000:3.0:1787432731.600697:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787432731.600704:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff948409d2f000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432731.600744:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94830379b100 x1874258609483136/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432731.600761:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432731.600764:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787432731.600766:0:8:0:(import.c:65:import_set_state_nolock()) ffff9484166d0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432731.600769:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 533 00000100:00080000:3.0:1787432731.600772:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787432731.600775:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9484166d0800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432731.600786:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94830379aa00 x1874258609483264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432731.600794:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432731.600797:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787432731.600799:0:8:0:(import.c:65:import_set_state_nolock()) ffff9484034a6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432731.600801:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 533 00000100:00080000:3.0:1787432731.600804:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787432731.600806:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9484034a6800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432731.600814:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94830379a680 x1874258609483392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787432731.601269:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609483136:0@lo:38:kworker.0 00000100:00100000:1.0:1787432731.601337:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432731.601388:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609483264:0@lo:8:kworker.0 00000400:00000100:1.0:1787432731.601423:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258609483264 offset 0 length 520: 4 00000100:00100000:1.0:1787432731.601439:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609483392:0@lo:8:kworker.0 00000400:00000100:1.0:1787432731.601455:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258609483392 offset 0 length 520: 4 00000100:00100000:3.0:1787432731.602326:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609483136 00000100:00100000:3.0:1787432731.602337:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609483136 00000100:00100000:3.0:1787432731.602383:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432731.602391:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874258609483136:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787432731.602410:0:17159:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787432731.611471:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3641:1874258609483008:0@lo:400:kworker.0 00000100:00100000:2.0:1787432731.611578:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432731.611690:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432731.611699:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609483520:0@lo:400:kworker.0 00000100:00100000:2.0:1787432731.611739:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432731.611784:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609483520 00000100:00100000:2.0:1787432731.611793:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609483520 00000100:00100000:2.0:1787432731.611842:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787432731.611852:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609483520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432731.611910:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609483520:12345-0@lo:400:kworker.0 Request processed in 59us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432731.611918:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787432731.611962:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff948303798a80 x1874258609483520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432731.611987:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609483520:0@lo:400:kworker.0 00000100:00100000:1.0:1787432731.622079:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609483008 00000100:00100000:1.0:1787432731.622096:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609483008 00000100:00100000:1.0:1787432731.622183:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787432731.622206:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:3641:x1874258609483008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432731.622315:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:3641:x1874258609483008:12345-0@lo:400:kworker.0 Request processed in 111us (10738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432731.622324:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787432731.622387:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3641:1874258609483008:0@lo:400:kworker.0 00000100:00100000:2.0:1787432731.635382:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874258609483136:12345-0@lo:38:kworker.0 Request processed in 32980us (34032us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787432731.635398:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787432731.635479:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948409d2f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432731.635486:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787432731.635491:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609483136:0@lo:38:kworker.0 00010000:00010000:3.0:1787432731.788133:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432732.299278:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787432732.813439:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432733.326846:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00010000:00010000:2.0:1787432733.844453:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787432734.284792:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787432734.347622:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787432734.870011:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432735.372718:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787432735.884689:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432736.404350:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00000100:00080000:3.0:1787432736.715501:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787432736.715509:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787432736.715514:0:36:0:(import.c:65:import_set_state_nolock()) ffff948409d2f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432736.715523:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 542 00000100:00080000:3.0:1787432736.715528:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787432736.715536:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff948409d2f000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432736.715561:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948303799880 x1874258609483776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432736.715573:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432736.715577:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787432736.715580:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432736.715583:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787432736.715627:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609483904:0@lo:400:kworker.0 00000100:00100000:3.0:1787432736.715710:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432736.715777:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432736.715783:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3644:1874258609483648:0@lo:400:kworker.0 00000100:00100000:3.0:1787432736.715813:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432736.715861:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609483904 00000100:00100000:3.0:1787432736.715868:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609483904 00000100:00100000:3.0:1787432736.715942:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787432736.715953:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609483904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432736.716011:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609483904:12345-0@lo:400:kworker.0 Request processed in 60us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432736.716018:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787432736.716042:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609483648 00000100:00100000:3.0:1787432736.716046:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609483648 00000100:00100000:3.0:1787432736.716073:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787432736.716079:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948402c9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:3644:x1874258609483648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432736.716111:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948402c9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:3644:x1874258609483648:12345-0@lo:400:kworker.0 Request processed in 32us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432736.716117:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787432736.716189:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3644:1874258609483648:0@lo:400:kworker.0 00010000:00080000:3.0:1787432736.716204:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff948303799180 x1874258609483904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432736.716216:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609483904:0@lo:400:kworker.0 00000100:00100000:1.0:1787432736.719858:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609483776:0@lo:38:kworker.0 00000100:00100000:1.0:1787432736.719939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432736.720050:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609483776 00000100:00100000:0.0:1787432736.720059:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609483776 00000100:00100000:0.0:1787432736.720103:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432736.720111:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609483776:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787432736.720130:0:17160:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787432736.742307:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609483776:12345-0@lo:38:kworker.0 Request processed in 22187us (22360us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787432736.742337:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787432736.742459:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948409d2f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432736.742467:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787432736.742472:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609483776:0@lo:38:kworker.0 00000020:01000004:0.0:1787432736.841898:0:17885:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787432736.841903:0:17885:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787432736.841905:0:17885:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787432736.842007:0:17885:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94843f837000 00000020:01000004:0.0:1787432736.842023:0:17885:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1787432736.842034:0:17885:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787432736.842050:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff94843361cd28) 00000020:00000080:0.0:1787432736.842067:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1787432736.907350:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787432736.922684:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1787432736.928772:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787432736.929587:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787432736.930115:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787432736.930638:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787432736.938308:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787432736.938750:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1787432736.939016:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1787432736.939522:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1787432736.939853:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1787432736.940135:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787432736.940479:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1787432736.940818:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1787432736.941040:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1787432736.953394:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1787432736.953669:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1787432736.954099:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1787432736.954303:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1787432736.954531:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787432736.954992:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1787432736.955679:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1787432736.956882:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1787432736.957920:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1787432736.958678:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1787432736.959064:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787432736.959295:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1787432736.959936:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1787432736.960350:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787432736.967706:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1787432736.968605:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787432736.969016:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787432736.969265:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787432736.969527:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1787432736.970896:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1787432736.971854:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787432736.972204:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1787432736.972443:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1787432736.972672:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1787432736.972940:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787432736.973151:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787432736.973461:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1787432736.973681:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787432736.975052:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787432736.975437:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787432736.975885:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787432736.976110:0:17885:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00080000:01000000:2.0:1787432736.978289:0:17885:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787432736.978544:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787432736.978557:0:17885:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787432736.978583:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xca72b3b33563fd7f 00000020:01000004:2.0:1787432736.978593:0:17885:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787432736.978615:0:17885:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.124@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787432736.978619:0:17885:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787432736.978625:0:17885:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787432736.978654:0:17885:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787432736.978659:0:17885:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.124@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787432737.000380:0:17885:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.124@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787432737.000429:0:17885:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.124@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1787432737.000434:0:17885:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787432737.000436:0:17885:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787432737.000437:0:17885:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432737.000438:0:17885:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432737.000440:0:17885:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432737.000441:0:17885:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432737.000442:0:17885:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787432737.000444:0:17885:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432737.000445:0:17885:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787432737.000449:0:17885:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1787432737.000452:0:17885:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787432737.000453:0:17885:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787432737.000454:0:17885:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432737.000455:0:17885:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432737.000456:0:17885:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432737.000457:0:17885:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432737.000458:0:17885:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787432737.000459:0:17885:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432737.000460:0:17885:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787432737.000486:0:17885:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787432737.000507:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303799180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609484032:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787432737.001131:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432737.001279:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112df3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432737.005417:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609484032 00000100:00100000:1.0:1787432737.005431:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609484032 00000100:00100000:1.0:1787432737.005555:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787432737.005574:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948402c9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17885:x1874258609484032:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787432737.005609:0:17147:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787432737.005613:0:17147:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1787432737.005621:0:17147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787432737.006088:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948402c9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17885:x1874258609484032:12345-0@lo:253:mount.lustre.0 Request processed in 523us (4956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432737.006113:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787432737.006263:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303799180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609484032:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787432737.006277:0:17885:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787432737.006281:0:17885:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787432737.006283:0:17885:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787432737.006284:0:17885:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432737.006285:0:17885:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432737.006286:0:17885:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432737.006288:0:17885:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432737.006289:0:17885:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787432737.006291:0:17885:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432737.006299:0:17885:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787432737.006317:0:17885:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94843f837000 from lustre-MDT0001 10000000:01000000:2.0:1787432737.006346:0:17885:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787432737.006349:0:17885:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787432737.006356:0:17885:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9483030f0000 local copy 00010000:00010000:2.0:1787432737.006366:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432737.006465:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609484160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432737.006499:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432737.011330:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112dfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432737.013800:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609484160 00000100:00100000:3.0:1787432737.013815:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609484160 00000100:00100000:3.0:1787432737.013888:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787432737.013900:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17885:x1874258609484160:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432737.014059:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17885:x1874258609484160:12345-0@lo:501:mount.lustre.0 Request processed in 161us (7559us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787432737.014067:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787432737.015824:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609484160:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787432737.015852:0:17885:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787432737.015903:0:17885:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787432737.015913:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.015923:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432737.015952:0:17885:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94843f837000 10000000:01000000:2.0:1787432737.015957:0:17885:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787432737.015962:0:17885:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9483030f0000 10000000:01000000:2.0:1787432737.015965:0:17885:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787432737.015969:0:17885:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9483030f0000 from 1 10000000:01000000:2.0:1787432737.015971:0:17885:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787432737.016007:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4000/0xca72b3b33563fd86 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.016016:0:17885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484032e4000/0xca72b3b33563fd86 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.016041:0:17885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484032e4000/0xca72b3b33563fd86 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432737.016062:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609484288:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787432737.016116:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432737.016150:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112dfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432737.016308:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609484288 00000100:00100000:3.0:1787432737.016314:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609484288 00000100:00100000:3.0:1787432737.016351:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787432737.016367:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+12:17885:x1874258609484288:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432737.016380:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432737.016393:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9483039f1c00/0xca72b3b33563fd8d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fd86 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432737.016418:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9483039f1c00/0xca72b3b33563fd8d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fd86 expref: 13 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432737.016426:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9483039f1c00/0xca72b3b33563fd8d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fd86 expref: 13 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432737.016435:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f1c00, rc 0) 00000100:00100000:3.0:1787432737.016470:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+13:17885:x1874258609484288:12345-0@lo:101:mount.lustre.0 Request processed in 104us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432737.016477:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787432737.016558:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609484288:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432737.016581:0:17885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484032e4000/0xca72b3b33563fd86 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.016590:0:17885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484032e4000/0xca72b3b33563fd86 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fd8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432737.016606:0:17885:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787432737.016624:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4000/0xca72b3b33563fd86 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.016631:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484032e4000/0xca72b3b33563fd86 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432737.016639:0:17885:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff94843f837000 10000000:01000000:2.0:1787432737.016643:0:17885:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787432737.016646:0:17885:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff94843f837000 from 1 10000000:01000000:2.0:1787432737.016648:0:17885:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787432737.016663:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5600/0xca72b3b33563fd94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.016669:0:17885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484032e5600/0xca72b3b33563fd94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.016683:0:17885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484032e5600/0xca72b3b33563fd94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432737.016696:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609484416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787432737.016721:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432737.016739:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112dfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432737.016850:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609484416 00000100:00100000:3.0:1787432737.016854:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609484416 00000100:00100000:3.0:1787432737.016886:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787432737.016894:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+13:17885:x1874258609484416:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432737.016901:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432737.016909:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9483039f0000/0xca72b3b33563fd9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fd94 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432737.016923:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9483039f0000/0xca72b3b33563fd9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fd94 expref: 14 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432737.016932:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9483039f0000/0xca72b3b33563fd9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fd94 expref: 14 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432737.016950:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f0000, rc 0) 00000100:00100000:3.0:1787432737.016992:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+14:17885:x1874258609484416:12345-0@lo:101:mount.lustre.0 Request processed in 98us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432737.016998:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787432737.017072:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609484416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432737.017083:0:17885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484032e5600/0xca72b3b33563fd94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.017091:0:17885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484032e5600/0xca72b3b33563fd94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fd9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432737.017102:0:17885:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787432737.017116:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5600/0xca72b3b33563fd94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.017123:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484032e5600/0xca72b3b33563fd94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fd9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432737.017128:0:17885:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787432737.017132:0:17885:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787432737.017136:0:17885:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff94843f837000 10000000:01000000:2.0:1787432737.017138:0:17885:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787432737.017142:0:17885:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787432737.017144:0:17885:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787432737.017157:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563fda2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.017195:0:17885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563fda2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.017203:0:17885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563fda2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432737.017217:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609484544:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787432737.017245:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432737.017257:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112dfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432737.017346:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609484544 00000100:00100000:3.0:1787432737.017350:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609484544 00000100:00100000:3.0:1787432737.017369:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787432737.017376:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+14:17885:x1874258609484544:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432737.017382:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432737.017390:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9483039f1000/0xca72b3b33563fda9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fda2 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432737.017404:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9483039f1000/0xca72b3b33563fda9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fda2 expref: 15 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432737.017412:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9483039f1000/0xca72b3b33563fda9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fda2 expref: 15 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432737.017418:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9483039f1000, rc 0) 00000100:00100000:3.0:1787432737.017446:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+15:17885:x1874258609484544:12345-0@lo:101:mount.lustre.0 Request processed in 70us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432737.017452:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787432737.017524:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609484544:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432737.017534:0:17885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563fda2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fda9 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.017542:0:17885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563fda2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fda9 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787432737.019147:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1787432737.020158:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432737.024416:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787432737.024477:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1787432737.024492:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1787432737.024509:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1787432737.024521:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1787432737.024534:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1787432737.024546:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1787432737.024558:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1787432737.024649:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1787432737.024666:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1787432737.024688:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1787432737.024701:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1787432737.024712:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1787432737.024723:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1787432737.024735:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1787432737.024747:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1787432737.024758:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1787432737.024770:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1787432737.024782:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1787432737.024794:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1787432737.024805:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1787432737.024817:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1787432737.024830:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1787432737.024857:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1787432737.024863:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1787432737.025008:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609484672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432737.025085:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432737.025135:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484034cde40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432737.025274:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609484672 00000100:00100000:3.0:1787432737.025283:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609484672 00000100:00100000:3.0:1787432737.025344:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787432737.025355:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+15:17885:x1874258609484672:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432737.025523:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+15:17885:x1874258609484672:12345-0@lo:501:mount.lustre.0 Request processed in 169us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432737.025538:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787432737.025804:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609484672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432737.025846:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609484800:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432737.025905:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.025936:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484012ed3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432737.025997:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609484800 00000100:00100000:1.0:1787432737.026001:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609484800 00000100:00100000:1.0:1787432737.026037:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787432737.026045:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+15:17885:x1874258609484800:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432737.026731:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+15:17885:x1874258609484800:12345-0@lo:503:mount.lustre.0 Request processed in 682us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432737.026741:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787432737.026995:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609484800:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787432737.027444:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787432737.027527:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609484928:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432737.027889:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.027980:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff948404ca86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432737.031121:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609484928 00000100:00100000:1.0:1787432737.031140:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609484928 00000100:00100000:0.0:1787432737.031320:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787432737.031334:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+15:17885:x1874258609484928:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432737.032610:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+15:17885:x1874258609484928:12345-0@lo:502:mount.lustre.0 Request processed in 1273us (4715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432737.032622:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787432737.032779:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609484928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787432737.033009:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787432737.033039:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1787432737.033055:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1787432737.033068:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1787432737.033082:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1787432737.033095:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1787432737.033120:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1787432737.033135:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1787432737.033146:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1787432737.033158:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1787432737.033204:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1787432737.033219:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1787432737.033245:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1787432737.033263:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1787432737.033277:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1787432737.033291:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1787432737.033305:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1787432737.033318:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1787432737.033329:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1787432737.033342:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1787432737.033354:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1787432737.033367:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1787432737.033381:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1787432737.033394:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1787432737.033406:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1787432737.033417:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1787432737.033429:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1787432737.033442:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1787432737.033453:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1787432737.033465:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1787432737.033477:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1787432737.033489:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1787432737.033504:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1787432737.033519:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1787432737.033533:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1787432737.033546:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1787432737.033560:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1787432737.033588:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1787432737.033603:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1787432737.033616:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1787432737.033628:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1787432737.033642:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1787432737.033656:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1787432737.033668:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1787432737.033706:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609485056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432737.033770:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432737.033817:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484034cd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432737.034028:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609485056 00000100:00100000:3.0:1787432737.034034:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609485056 00000100:00100000:3.0:1787432737.034091:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787432737.034109:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+15:17885:x1874258609485056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432737.034254:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+15:17885:x1874258609485056:12345-0@lo:502:mount.lustre.0 Request processed in 155us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432737.034261:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787432737.034480:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609485056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787432737.034531:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1787432737.034540:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1787432737.035709:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432737.035723:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432737.035725:0:17889:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787432737.035730:0:17889:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787432737.035733:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787432737.035751:0:17889:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff94841de98000) 00000020:00000080:1.0:1787432737.035775:0:17889:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1787432737.035781:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787432737.035853:0:17889:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787432737.035861:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xca72b3b33563fdb7 00000020:00000080:1.0:1787432737.036074:0:17889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787432737.036079:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432737.036083:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432737.036084:0:17889:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787432737.036087:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432737.036090:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432737.036091:0:17889:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787432737.036094:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787432737.036101:0:17889:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff94841de999b8) 00000020:00000080:1.0:1787432737.036124:0:17889:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1787432737.036136:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787432737.036138:0:17889:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787432737.036141:0:17889:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787432737.036147:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787432737.036236:0:17889:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94843f837000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787432737.036250:0:17889:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9484336599b8) 00000020:00000080:1.0:1787432737.036259:0:17889:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1787432737.036318:0:17889:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787432737.036324:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b33563fdcc 00000020:00000080:1.0:1787432737.036411:0:17889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787432737.036418:0:17889:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787432737.036423:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xca72b3b33563fdd3 00080000:01000000:1.0:1787432737.036428:0:17889:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787432737.036431:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xca72b3b33563fdda 00010000:00010000:3.0:1787432737.153512:0:17889:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787432737.154960:0:17889:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1787432737.155462:0:17889:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787432737.158947:0:17889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787432737.158961:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432737.158968:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432737.158970:0:17889:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787432737.158975:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432737.158981:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432737.158982:0:17889:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787432737.158986:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787432737.158992:0:17889:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.124@tcp to nid 0x20000c0a8cc7c (192.168.204.124@tcp) 00000020:00000080:2.0:1787432737.159022:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787432737.159051:0:17889:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9484349d19b8) 00000020:00000080:2.0:1787432737.159074:0:17889:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1787432737.159082:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787432737.159155:0:17889:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787432737.159179:0:17889:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787432737.159186:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xca72b3b33563fde8 00010000:00080000:2.0:1787432737.159218:0:17889:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9483039ef800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.124@tcp at head 00010000:00010000:2.0:1787432737.166758:0:17889:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1787432737.170208:0:17889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787432737.170225:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787432737.170271:0:17889:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787432737.170295:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b33563fdef 00000100:00080000:3.0:1787432737.170305:0:17889:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787432737.170311:0:17889:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9483039ef800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432737.170349:0:17889:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948303798700 x1874258609485184/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432737.170373:0:17889:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1787432737.170420:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432737.170424:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432737.170426:0:17889:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1787432737.170429:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787432737.170432:0:17889:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787432737.170434:0:17889:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787432737.170436:0:17889:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787432737.170438:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787432737.170440:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432737.170442:0:17889:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787432737.170456:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432737.170461:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432737.170463:0:17889:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1787432737.170466:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787432737.170500:0:17889:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787432737.170514:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432737.170517:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432737.170520:0:17889:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1787432737.170522:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787432737.170524:0:17889:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1787432737.170525:0:17889:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787432737.170527:0:17889:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787432737.170529:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787432737.170531:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432737.170532:0:17889:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787432737.170535:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787432737.170538:0:17889:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787432737.170541:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432737.170543:0:17889:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787432737.170546:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787432737.170549:0:17889:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.124@tcp to nid 0x20000c0a8cc7c (192.168.204.124@tcp) 00000100:00100000:1.0:1787432737.170762:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609485184:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787432737.170833:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432737.170912:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609485184 00000100:00100000:1.0:1787432737.170920:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609485184 00000100:00100000:1.0:1787432737.170954:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787432737.170963:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1874258609485184:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787432737.170985:0:17159:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:1.0:1787432737.171015:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b33563fdf6 00000004:00100000:1.0:1787432737.171045:0:17159:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787432737.171050:0:17159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787432737.171293:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787432737.171298:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787432737.171302:0:8:0:(import.c:65:import_set_state_nolock()) ffff948409d2f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432737.171306:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 547 00000100:00080000:2.0:1787432737.171318:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787432737.171323:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff948409d2f000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432737.171346:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9484348dea00 x1874258609485312/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432737.171366:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432737.171369:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787432737.171372:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432737.171375:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787432737.171412:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609485440:0@lo:400:kworker.0 00000100:00100000:2.0:1787432737.171450:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432737.171487:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609485440 00000100:00100000:2.0:1787432737.171491:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609485440 00000100:00100000:2.0:1787432737.171524:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787432737.171532:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609485440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432737.171591:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609485440:12345-0@lo:400:kworker.0 Request processed in 59us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432737.171597:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787432737.171635:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9484348dd180 x1874258609485440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432737.171648:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609485440:0@lo:400:kworker.0 00000100:00100000:1.0:1787432737.171848:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609485312:0@lo:38:kworker.0 00000100:00100000:1.0:1787432737.171892:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1787432737.172027:0:17889:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787432737.172043:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787432737.172058:0:17889:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff94843365cd28) 00000020:00000080:1.0:1787432737.172083:0:17889:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787432737.172090:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787432737.172197:0:17889:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787432737.172204:0:17889:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787432737.172210:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xca72b3b33563fe04 00010000:00080000:1.0:1787432737.172239:0:17889:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948434887000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.124@tcp at head 00010000:00010000:1.0:1787432737.172469:0:17889:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1787432737.173438:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787432737.173451:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1787432737.174500:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609485312 00000100:00100000:3.0:1787432737.174511:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609485312 00000040:01000000:2.0:1787432737.175048:0:17889:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787432737.175453:0:17889:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1787432737.176324:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787432737.176335:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1874258609485312:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787432737.176434:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1874258609485312:12345-0@lo:38:kworker.0 Request processed in 99us (4541us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787432737.176442:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787432737.176485:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787432737.176493:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948409d2f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432737.176498:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787432737.176502:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609485312:0@lo:38:kworker.0 00000040:00080000:2.0:1787432737.177452:0:17889:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1787432737.179842:0:17159:0:(import.c:65:import_set_state_nolock()) ffff948410647800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432737.179950:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1874258609485184:12345-0@lo:38:llog_process_th.0 Request processed in 8985us (9115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432737.179964:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432737.179999:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787432737.180011:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000040:00080000:2.0:1787432737.180016:0:17889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00080000:0.0:1787432737.180022:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787432737.180030:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787432737.180033:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9483039ef800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787432737.180050:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609485184:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787432737.180219:0:17889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:2.0:1787432737.180302:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609485568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432737.180359:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432737.180502:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609485568 00000100:00100000:3.0:1787432737.180509:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609485568 00000100:00100000:3.0:1787432737.180549:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432737.180710:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1874258609485568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787432737.180740:0:17160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787432737.180795:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1874258609485568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 237us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432737.180802:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787432737.180924:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609485568:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787432737.181746:0:17895:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787432737.181752:0:17895:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787432737.184256:0:17889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787432737.184273:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787432737.184315:0:17889:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787432737.184338:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b33563fe0b 00000100:00080000:2.0:1787432737.184348:0:17889:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787432737.184354:0:17889:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff948434887000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432737.184389:0:17889:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9484348dc380 x1874258609485696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432737.184419:0:17889:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787432737.184466:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609485696:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1787432737.184499:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432737.184505:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432737.184507:0:17889:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787432737.184510:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787432737.184513:0:17889:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1787432737.184515:0:17889:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787432737.184516:0:17889:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787432737.184518:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787432737.184521:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432737.184525:0:17889:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000400:00000100:0.0:1787432737.184525:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258609485696 offset 0 length 520: 4 00000020:01000000:2.0:1787432737.184529:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787432737.184533:0:17889:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787432737.184539:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432737.184547:0:17889:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787432737.184552:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787432737.184556:0:17889:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.124@tcp to nid 0x20000c0a8cc7c (192.168.204.124@tcp) 00000020:01000000:2.0:1787432737.184591:0:17889:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787432737.184594:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787432737.184608:0:17889:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9484349d0000) 00000020:00000080:2.0:1787432737.184620:0:17889:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1787432737.184626:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787432737.184682:0:17889:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787432737.184690:0:17889:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787432737.184696:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xca72b3b33563fe19 00000100:00080000:1.0:1787432737.184698:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787432737.184704:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787432737.184708:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787432737.184711:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:2.0:1787432737.184730:0:17889:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94843c7f3800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.124@tcp at head 00010000:00010000:2.0:1787432737.184949:0:17889:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1787432737.185016:0:17889:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787432737.185031:0:17889:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787432737.189734:0:17889:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432737.190670:0:17889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787432737.190811:0:17889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787432737.192013:0:17897:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787432737.192020:0:17897:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787432737.192631:0:17889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787432737.192644:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787432737.192686:0:17889:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787432737.192711:0:17889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b33563fe20 00000100:00080000:0.0:1787432737.192722:0:17889:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787432737.192728:0:17889:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94843c7f3800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432737.192763:0:17889:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948303908700 x1874258609485824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432737.192796:0:17889:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787432737.192874:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432737.192879:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432737.192881:0:17889:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787432737.192884:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432737.192889:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432737.192891:0:17889:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787432737.192894:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787432737.192896:0:17889:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787432737.192899:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432737.192902:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432737.192903:0:17889:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787432737.192906:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432737.192908:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432737.192910:0:17889:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787432737.192913:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787432737.192936:0:17889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432737.192940:0:17889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432737.192941:0:17889:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787432737.192944:0:17889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00100000:1.0:1787432737.192970:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609485824:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787432737.193034:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258609485824 offset 0 length 520: 4 00000020:01000000:3.0:1787432737.193090:0:17885:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 00000100:00080000:2.0:1787432737.193131:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 10000000:01000000:3.0:1787432737.193133:0:17885:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00000100:00080000:2.0:1787432737.193138:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787432737.193142:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432737.193146:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787432737.193161:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563fda2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fda9 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432737.193196:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484032e4a00/0xca72b3b33563fda2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fda9 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432737.193205:0:17885:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94843f837000 from 1 10000000:01000000:3.0:1787432737.193208:0:17885:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787432737.193234:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f0a00/0xca72b3b33563fe27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432737.193242:0:17885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9483039f0a00/0xca72b3b33563fe27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432737.193253:0:17885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9483039f0a00/0xca72b3b33563fe27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432737.193271:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609485952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787432737.193311:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432737.193350:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb119c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432737.193364:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609485952 00000100:00100000:2.0:1787432737.193372:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609485952 00000100:00100000:2.0:1787432737.193422:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787432737.193433:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+15:17885:x1874258609485952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432737.193447:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432737.193460:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484032e5400/0xca72b3b33563fe2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fe27 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.193492:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e5400/0xca72b3b33563fe2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fe27 expref: 16 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.193504:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484032e5400/0xca72b3b33563fe2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fe27 expref: 16 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.193513:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e5400, rc 0) 00000100:00100000:2.0:1787432737.193567:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+16:17885:x1874258609485952:12345-0@lo:101:mount.lustre.0 Request processed in 135us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432737.193575:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787432737.193598:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609485952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432737.193614:0:17885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9483039f0a00/0xca72b3b33563fe27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe2e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432737.193623:0:17885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9483039f0a00/0xca72b3b33563fe27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fe2e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432737.194366:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609486080:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787432737.194686:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.194724:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb119c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432737.196020:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609486080 00000100:00100000:1.0:1787432737.196030:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609486080 00000100:00100000:1.0:1787432737.196087:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787432737.196097:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+16:17885:x1874258609486080:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787432737.196118:0:17149:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787432737.196140:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787432737.196143:0:17149:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787432737.196353:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+16:17885:x1874258609486080:12345-0@lo:256:mount.lustre.0 Request processed in 257us (1667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432737.196362:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787432737.196390:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609486080:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787432737.197028:0:17885:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787432737.197062:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f0a00/0xca72b3b33563fe27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe2e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.197073:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9483039f0a00/0xca72b3b33563fe27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe2e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432737.197081:0:17885:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94843f837000 from 1 10000000:01000000:0.0:1787432737.197083:0:17885:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787432737.197116:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fe35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.197123:0:17885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fe35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.197133:0:17885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fe35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432737.197154:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609486208:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787432737.197231:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.197273:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432737.197283:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609486208 00000100:00100000:2.0:1787432737.197290:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609486208 00000100:00100000:2.0:1787432737.197333:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787432737.197341:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+16:17885:x1874258609486208:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432737.197351:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432737.197363:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484032e4200/0xca72b3b33563fe3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fe35 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.197385:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e4200/0xca72b3b33563fe3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fe35 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.197395:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484032e4200/0xca72b3b33563fe3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fe35 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.197403:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e4200, rc 0) 00000100:00100000:2.0:1787432737.197446:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17885:x1874258609486208:12345-0@lo:101:mount.lustre.0 Request processed in 106us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432737.197452:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787432737.197526:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609486208:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432737.197541:0:17885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fe35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe3c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.197551:0:17885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fe35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fe3c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787432737.197686:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787432737.197740:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609486336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432737.197769:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.197794:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432737.197905:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609486336 00000100:00100000:3.0:1787432737.197910:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609486336 00000100:00100000:3.0:1787432737.197988:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787432737.197997:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17885:x1874258609486336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432737.198103:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17885:x1874258609486336:12345-0@lo:501:mount.lustre.0 Request processed in 107us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432737.198110:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787432737.198144:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609486336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432737.198199:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609486464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432737.198238:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432737.208534:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609486464 00000100:00100000:2.0:1787432737.208550:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609486464 00000100:00100000:2.0:1787432737.208759:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787432737.208770:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17885:x1874258609486464:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432737.209678:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432737.210882:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17885:x1874258609486464:12345-0@lo:503:mount.lustre.0 Request processed in 2098us (12626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432737.210895:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787432737.210925:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609486464:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787432737.211385:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787432737.211470:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609486592:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432737.211522:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.211572:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432737.211743:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609486592 00000100:00100000:1.0:1787432737.211750:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609486592 00000100:00100000:1.0:1787432737.211796:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787432737.211805:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17885:x1874258609486592:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432737.211918:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17885:x1874258609486592:12345-0@lo:502:mount.lustre.0 Request processed in 114us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432737.211925:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787432737.212005:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609486592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787432737.212349:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787432737.212375:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1787432737.212390:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1787432737.212404:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1787432737.212419:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1787432737.212432:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1787432737.212445:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1787432737.212459:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1787432737.212474:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787432737.212504:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1787432737.212520:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1787432737.212541:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609486720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432737.213130:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.213289:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432737.220656:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609486720 00000100:00100000:3.0:1787432737.220673:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609486720 00000100:00100000:0.0:1787432737.224197:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787432737.224211:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17885:x1874258609486720:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432737.224414:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17885:x1874258609486720:12345-0@lo:502:mount.lustre.0 Request processed in 206us (11284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432737.224423:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787432737.224738:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609486720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787432737.224834:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:2.0:1787432737.224850:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1787432737.225609:0:17899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432737.225619:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432737.225621:0:17899:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787432737.225627:0:17899:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94843f837000 00000020:00000080:2.0:1787432737.225630:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787432737.225638:0:17899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432737.225640:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432737.225642:0:17899:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787432737.225644:0:17899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432737.225646:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432737.225647:0:17899:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787432737.225663:0:17899:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94843f837000 00000020:00000080:2.0:1787432737.225665:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787432737.225727:0:17899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432737.225731:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432737.225733:0:17899:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787432737.225736:0:17899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432737.225739:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432737.225741:0:17899:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787432737.225744:0:17899:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94843f837000 00000020:00000080:2.0:1787432737.225747:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787432737.225779:0:17899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432737.225782:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432737.225783:0:17899:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787432737.225786:0:17899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432737.225788:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432737.225790:0:17899:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787432737.225793:0:17899:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94843f837000 00000020:00000080:2.0:1787432737.225795:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787432737.225832:0:17899:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432737.225836:0:17899:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432737.225837:0:17899:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787432737.225840:0:17899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1787432737.226323:0:17885:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787432737.226352:0:17885:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787432737.226370:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fe35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe3c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.226382:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fe35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe3c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432737.226437:0:17885:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787432737.226440:0:17885:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94843f837000 10000000:01000000:0.0:1787432737.226443:0:17885:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94843f837000 10000000:01000000:0.0:1787432737.226448:0:17885:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787432737.226454:0:17885:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94843f837000 from 1 10000000:01000000:0.0:1787432737.226456:0:17885:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787432737.226492:0:17885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304488a00/0xca72b3b33563fe43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.226500:0:17885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948304488a00/0xca72b3b33563fe43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.226512:0:17885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948304488a00/0xca72b3b33563fe43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432737.226534:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609486848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787432737.226603:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.226640:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432737.226816:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609486848 00000100:00100000:2.0:1787432737.226823:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609486848 00000100:00100000:2.0:1787432737.226880:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787432737.226889:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17885:x1874258609486848:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432737.226901:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432737.226913:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484032e4c00/0xca72b3b33563fe4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fe43 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.226934:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e4c00/0xca72b3b33563fe4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fe43 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.226957:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484032e4c00/0xca72b3b33563fe4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fe43 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432737.226965:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e4c00, rc 0) 00000100:00100000:2.0:1787432737.227013:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17885:x1874258609486848:12345-0@lo:101:mount.lustre.0 Request processed in 125us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432737.227020:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787432737.227099:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609486848:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432737.227112:0:17885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948304488a00/0xca72b3b33563fe43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe4a expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432737.227121:0:17885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948304488a00/0xca72b3b33563fe43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fe4a expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787432737.230729:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787432737.231077:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432737.231350:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1787432737.231376:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1787432737.231390:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1787432737.231404:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1787432737.231417:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1787432737.231430:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1787432737.231443:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1787432737.231474:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1787432737.231491:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1787432737.231503:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1787432737.231516:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1787432737.231528:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1787432737.231540:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1787432737.231553:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1787432737.231579:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1787432737.231594:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1787432737.231605:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1787432737.231616:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1787432737.231628:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1787432737.231642:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1787432737.231653:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1787432737.231663:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1787432737.231674:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1787432737.231701:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1787432737.231715:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1787432737.231726:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1787432737.231737:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1787432737.231749:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1787432737.231779:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1787432737.231785:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787432737.231875:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609486976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432737.231942:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.231978:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550b840 going to sleep for 11 seconds 00000100:00100000:1.0:1787432737.232348:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609486976 00000100:00100000:1.0:1787432737.232357:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609486976 00000100:00100000:1.0:1787432737.232419:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787432737.232430:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403060850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17885:x1874258609486976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432737.232568:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403060850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17885:x1874258609486976:12345-0@lo:501:mount.lustre.0 Request processed in 129us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432737.232576:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787432737.234295:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609486976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432737.234353:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609487104:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432737.234422:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.234459:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550b840 going to sleep for 11 seconds 00000100:00100000:1.0:1787432737.236395:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609487104 00000100:00100000:1.0:1787432737.236409:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609487104 00000100:00100000:1.0:1787432737.236463:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787432737.236474:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17885:x1874258609487104:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432737.236644:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17885:x1874258609487104:12345-0@lo:503:mount.lustre.0 Request processed in 170us (2221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432737.236653:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787432737.238422:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609487104:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787432737.242787:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787432737.242909:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609487232:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432737.243003:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.243050:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787432737.253533:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609487232 00000100:00100000:3.0:1787432737.253550:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609487232 00000100:00100000:3.0:1787432737.253628:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787432737.253639:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17885:x1874258609487232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432737.253833:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17885:x1874258609487232:12345-0@lo:502:mount.lustre.0 Request processed in 196us (10829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432737.253840:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787432737.254126:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609487232:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787432737.254445:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1787432737.254477:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1787432737.254493:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1787432737.254509:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1787432737.254524:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1787432737.254539:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1787432737.254552:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1787432737.254583:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1787432737.254601:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1787432737.254633:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1787432737.254853:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1787432737.254889:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1787432737.254916:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1787432737.254932:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1787432737.254946:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1787432737.254957:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1787432737.254970:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1787432737.254985:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1787432737.255005:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1787432737.255021:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1787432737.255034:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1787432737.255047:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1787432737.255062:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1787432737.255084:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1787432737.255101:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1787432737.255131:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1787432737.255148:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1787432737.255463:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1787432737.255489:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1787432737.255506:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1787432737.255525:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1787432737.255541:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1787432737.255557:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1787432737.257636:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1787432737.258131:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1787432737.258153:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1787432737.258192:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1787432737.258216:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1787432737.258228:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1787432737.258241:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1787432737.258259:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1787432737.258297:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1787432737.258318:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1787432737.258335:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1787432737.258350:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1787432737.258377:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1787432737.258395:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1787432737.258411:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1787432737.258474:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609487360:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432737.258882:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.258935:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609487360 00000100:00100000:0.0:1787432737.259071:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609487360 00000100:00100000:0.0:1787432737.259123:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787432737.259133:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17885:x1874258609487360:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432737.259296:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17885:x1874258609487360:12345-0@lo:502:mount.lustre.0 Request processed in 163us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432737.259304:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787432737.259362:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787432737.259389:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609487360:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787432737.261840:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1787432737.261907:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1787432737.262073:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609487488:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432737.262154:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.262218:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787432737.262264:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609487488 00000100:00100000:3.0:1787432737.262273:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609487488 00000100:00100000:3.0:1787432737.262338:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787432737.262349:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17885:x1874258609487488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432737.262507:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17885:x1874258609487488:12345-0@lo:502:mount.lustre.0 Request processed in 159us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432737.262516:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787432737.263001:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609487488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787432737.263084:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1787432737.263095:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787432737.268346:0:17904:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787432737.268366:0:17904:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff94843b9599b8) 00000020:00000080:2.0:1787432737.268393:0:17904:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787432737.268505:0:17904:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94843f837000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787432737.268509:0:17904:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94843f837000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787432737.268512:0:17904:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94843f837000 3 00010000:00080000:2.0:1787432737.268544:0:17904:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94843f83d800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.124@tcp at head 00010000:00010000:2.0:1787432737.273800:0:17904:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1787432737.276592:0:17904:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1787432737.276639:0:17904:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787432737.276652:0:17904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xca72b3b33563fe58 00000100:00080000:2.0:1787432737.276663:0:17904:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787432737.276669:0:17904:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94843f83d800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432737.276703:0:17904:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9484348ded80 x1874258609487616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432737.276728:0:17904:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787432737.276763:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432737.276768:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787432737.276770:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432737.276773:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787432737.276899:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874258609487616:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787432737.276965:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.277024:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609487616 00000100:00100000:0.0:1787432737.277030:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609487616 00000100:00100000:0.0:1787432737.277062:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432737.277069:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1874258609487616:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787432737.277096:0:17154:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:0.0:1787432737.277151:0:17154:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xca72b3b33563fe5f 00000004:00100000:0.0:1787432737.277186:0:17154:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787432737.277216:0:17154:0:(import.c:65:import_set_state_nolock()) ffff94843f86c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432737.277268:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874258609487616:12345-0@lo:38:llog_process_th.0 Request processed in 197us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432737.277275:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787432737.277315:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9484348ded80 x1874258609487616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432737.277325:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787432737.277332:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787432737.277339:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787432737.277343:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787432737.277345:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843f83d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787432737.277351:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874258609487616:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787432737.281042:0:17904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:0.0:1787432737.281982:0:17885:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787432737.282021:0:17885:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787432737.282041:0:17885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304488a00/0xca72b3b33563fe43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe4a expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.282054:0:17885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948304488a00/0xca72b3b33563fe43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe4a expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787432737.282111:0:17885:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787432737.282114:0:17885:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787432737.282115:0:17885:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787432737.282117:0:17885:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787432737.282118:0:17885:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787432737.282119:0:17885:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787432737.282125:0:17885:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787432737.282127:0:17885:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787432737.282129:0:17885:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787432737.282132:0:17885:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1787432737.282135:0:17885:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787432737.282136:0:17885:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787432737.282137:0:17885:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787432737.282138:0:17885:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787432737.282139:0:17885:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787432737.282140:0:17885:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787432737.282141:0:17885:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787432737.282142:0:17885:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787432737.282142:0:17885:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787432737.284249:0:17885:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787432737.284275:0:17885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609487744:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787432737.284344:0:17885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.284382:0:17885:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787432737.284406:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609487744 00000100:00100000:0.0:1787432737.284414:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609487744 00000100:00100000:0.0:1787432737.284472:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787432737.284480:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403063850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17885:x1874258609487744:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787432737.284508:0:17149:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787432737.284520:0:17149:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1787432737.292399:0:17134:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787432737.292631:0:17149:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787432737.292648:0:17149:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1787432737.292993:0:17170:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787432737.292998:0:17170:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787432737.293021:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948304489e00/0xca72b3b33563fe66 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.293043:0:17170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948303850200/0xca72b3b33563fd6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fd63 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.293052:0:17170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484032e5400/0xca72b3b33563fe2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fe27 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.293072:0:17170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948304489e00/0xca72b3b33563fe66 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.293113:0:17170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484032e5400/0xca72b3b33563fe2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563fe27 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.293129:0:17170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9484032e5400/0xca72b3b33563fe2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563fe27 expref: 18 pid: 17147 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432737.293145:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17170:1874258609487872:0@lo:104: 00000100:00100000:0.0:1787432737.293242:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432737.293298:0:17170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948303850200/0xca72b3b33563fd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563fd63 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.293307:0:17170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948303850200/0xca72b3b33563fd6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563fd63 expref: 18 pid: 17147 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432737.293316:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17170:1874258609488000:0@lo:104: 00000100:00100000:0.0:1787432737.293338:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.293355:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff94840550bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432737.293382:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609487872 00000100:00100000:0.0:1787432737.293389:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609487872 00000100:00100000:0.0:1787432737.293425:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609488000 00000100:00100000:0.0:1787432737.293428:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609488000 00000100:00100000:0.0:1787432737.293442:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432737.293450:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+4:17170:x1874258609487872:12345-0@lo:104: 00010000:00010000:0.0:1787432737.293462:0:17137:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9483039f0a00/0xca72b3b33563fe27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563fe2e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.293521:0:17137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787432737.293527:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+4:17170:x1874258609487872:12345-0@lo:104: Request processed in 77us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432737.293534:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432737.293553:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432737.293565:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+3:17170:x1874258609488000:12345-0@lo:104: 00010000:00010000:0.0:1787432737.293573:0:17137:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948304489800/0xca72b3b33563fd63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563fd6a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.293614:0:17137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787432737.293619:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+3:17170:x1874258609488000:12345-0@lo:104: Request processed in 61us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432737.293624:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787432737.293638:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787432737.293644:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9483039f0a00/0xca72b3b33563fe27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563fe2e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.293651:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1787432737.293655:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9483039f0a00/0xca72b3b33563fe27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563fe2e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.293664:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9483039f0a00/0xca72b3b33563fe27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563fe2e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432737.293671:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9483039f0a00/0xca72b3b33563fe27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563fe2e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432737.293678:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432737.293711:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9483039f0a00/0xca72b3b33563fe27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fe2e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.293718:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432737.293740:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9483039f0a00/0xca72b3b33563fe27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fe2e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.293747:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9483039f0a00/0xca72b3b33563fe27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fe2e expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.293759:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432737.293762:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948304489800/0xca72b3b33563fd63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563fd6a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.293768:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489800 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1787432737.293771:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948304489800/0xca72b3b33563fd63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563fd6a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.293778:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948304489800/0xca72b3b33563fd63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563fd6a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432737.293784:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948304489800/0xca72b3b33563fd63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563fd6a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432737.293789:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432737.293801:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948304489800/0xca72b3b33563fd63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fd6a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.293807:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432737.293813:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948304489800/0xca72b3b33563fd63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fd6a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.293829:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948304489800/0xca72b3b33563fd63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fd6a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.293843:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432737.293845:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432737.293846:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432737.293851:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432737.293873:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3644:1874258609488256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432737.293902:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.293933:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432737.293939:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3644:1874258609488128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432737.293959:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.294012:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17170:1874258609487872:0@lo:104: 00000100:00100000:0.0:1787432737.294021:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17170:1874258609488000:0@lo:104: 00010000:00010000:0.0:1787432737.294039:0:17170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948304489e00/0xca72b3b33563fe66 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432737.294115:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609488256 00000100:00100000:1.0:1787432737.294120:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609488256 00010000:00010000:1.0:1787432737.294142:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948303850200/0xca72b3b33563fd6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fd63 expref: 19 pid: 17147 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432737.294311:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609488128 00000100:00100000:1.0:1787432737.294315:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609488128 00010000:00010000:1.0:1787432737.294329:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484032e5400/0xca72b3b33563fe2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fe27 expref: 20 pid: 17147 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432737.294343:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787432737.294349:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:3644:x1874258609488256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432737.294359:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432737.294364:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948303850200/0xca72b3b33563fd6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fd63 expref: 20 pid: 17147 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432737.294379:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948303850200/0xca72b3b33563fd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563fd63 expref: 20 pid: 17147 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432737.294393:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303850200/0xca72b3b33563fd6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563fd63 expref: 20 pid: 17147 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432737.294404:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432737.294436:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+19:3644:x1874258609488256:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432737.294443:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787432737.294456:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432737.294462:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:3644:x1874258609488128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432737.294470:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432737.294475:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484032e5400/0xca72b3b33563fe2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fe27 expref: 18 pid: 17147 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432737.294483:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484032e5400/0xca72b3b33563fe2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563fe27 expref: 18 pid: 17147 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432737.294493:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e5400/0xca72b3b33563fe2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563fe27 expref: 18 pid: 17147 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432737.294501:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948304489e00/0xca72b3b33563fe66 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432737.294508:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948304489e00/0xca72b3b33563fe66 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787432737.294520:0:17139:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003171924s 00010000:00010000:1.0:1787432737.294531:0:17139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948304489e00/0xca72b3b33563fe66 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432737.294538:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948304489e00/0xca72b3b33563fe66 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432737.294544:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948304489e00/0xca72b3b33563fe66 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432737.294550:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948304489e00/0xca72b3b33563fe66 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432737.294555:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489e00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432737.294595:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948304489e00/0xca72b3b33563fe66 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432737.294603:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948304489e00/0xca72b3b33563fe66 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432737.294615:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948304489e00/0xca72b3b33563fe66 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432737.294624:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432737.294649:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:3644:x1874258609488128:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432737.294655:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432737.294688:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3644:1874258609488128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432737.294701:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3644:1874258609488256:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432737.294828:0:17170:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948304489e00/0xca72b3b33563fe66 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.294835:0:17170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948304489e00/0xca72b3b33563fe66 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432737.294842:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948304489e00/0xca72b3b33563fe66 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432737.295319:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403063850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+16:17885:x1874258609487744:12345-0@lo:253:mount.lustre.0 Request processed in 10837us (10972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432737.295328:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787432737.295697:0:17885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17885:1874258609487744:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787432737.295712:0:17885:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787432737.295724:0:17885:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787432737.295734:0:17885:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787432737.295735:0:17885:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432737.295736:0:17885:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432737.295737:0:17885:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432737.295739:0:17885:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432737.295740:0:17885:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787432737.295742:0:17885:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432737.295743:0:17885:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787432737.295758:0:17885:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:3.0:1787432737.311777:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1787432737.312017:0:17909:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1787432737.312022:0:17909:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787432737.312071:0:17910:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787432737.312915:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1787432737.313406:0:17910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787432737.315513:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787432737.315591:0:17910:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1787432737.316749:0:17911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17911:1874258609488384:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1787432737.317064:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1787432737.317123:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787432737.317590:0:17885:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787432737.317599:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1787432737.317640:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787432737.318080:0:17911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.318130:0:17911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335af480 going to sleep for 11 seconds 00000100:00100000:1.0:1787432737.318742:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609488384 00000100:00100000:1.0:1787432737.318758:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609488384 00000100:00100000:1.0:1787432737.318812:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432737.318823:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17911:x1874258609488384:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787432737.318933:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17911:x1874258609488384:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 111us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432737.318941:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:00080000:2.0:1787432737.319530:0:17885:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787432737.320080:0:17885:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787432737.320117:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787432737.320243:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787432737.323101:0:17911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17911:1874258609488384:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1787432737.323158:0:17911:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787432737.323228:0:17911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17911:1874258609488512:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787432737.323302:0:17911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.323352:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609488512 00000100:00100000:0.0:1787432737.323359:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609488512 00000100:00100000:0.0:1787432737.323404:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787432737.323412:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17911:x1874258609488512:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787432737.323535:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17911:x1874258609488512:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 123us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432737.323543:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787432737.323572:0:17911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335af480 going to sleep for 11 seconds 00000100:00100000:0.0:1787432737.323586:0:17911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17911:1874258609488512:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787432737.323649:0:17911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17911:1874258609488640:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787432737.323676:0:17911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.323710:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609488640 00000100:00100000:0.0:1787432737.323714:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609488640 00000100:00100000:0.0:1787432737.323749:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432737.323766:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17911:x1874258609488640:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787432737.323803:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17911:x1874258609488640:12345-0@lo:900:lod0001_rec0000.0 Request processed in 39us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432737.323809:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432737.323825:0:17911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335af000 going to sleep for 11 seconds 00010000:00080000:0.0:1787432737.323840:0:17911:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94830390aa00 x1874258609488640/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787432753 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432737.323850:0:17911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17911:1874258609488640:0@lo:900:lod0001_rec0000.0 00080000:10000000:2.0:1787432737.324743:0:17885:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:0.0:1787432737.325471:0:17911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17911:1874258609488768:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787432737.325536:0:17911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432737.325580:0:17911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335af480 going to sleep for 11 seconds 00000100:00100000:2.0:1787432737.325707:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609488768 00000100:00100000:2.0:1787432737.325715:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609488768 00000100:00100000:2.0:1787432737.325781:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787432737.325791:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17911:x1874258609488768:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787432737.326044:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17911:x1874258609488768:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 255us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432737.326052:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787432737.326126:0:17911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17911:1874258609488768:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1787432737.326207:0:17911:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:2.0:1787432737.330309:0:17885:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:0.0:1787432737.334356:0:17911:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787432737.335989:0:17911:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787432737.336002:0:17911:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:3.0:1787432737.338837:0:17885:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787432737.338889:0:17885:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb0c1c0d4b988 00100000:10000000:3.0:1787432737.338898:0:17885:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1787432737.345300:0:17885:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787432737.345335:0:17885:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.124@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787432737.345354:0:17885:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787432737.345383:0:17885:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1787432737.357595:0:17885:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787432737.358185:0:17885:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787432737.423742:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00010000:00010000:2.0:1787432737.936477:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787432738.385521:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787432738.453587:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787432738.955426:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787432739.083309:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787432739.083320:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94843f837000 from 8 10000000:01000000:2.0:1787432739.083325:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787432739.083372:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5800/0xca72b3b33563fe6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432739.083384:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484032e5800/0xca72b3b33563fe6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432739.083409:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484032e5800/0xca72b3b33563fe6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432739.083447:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609488896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787432739.083565:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432739.083646:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841223b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432739.084423:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609488896 00000100:00100000:1.0:1787432739.084432:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609488896 00000100:00100000:1.0:1787432739.084494:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787432739.084504:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+16:17151:x1874258609488896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432739.084517:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432739.084534:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303850a00/0xca72b3b33563fe74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fe6d expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432739.084568:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303850a00/0xca72b3b33563fe74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fe6d expref: 17 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432739.084587:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303850a00/0xca72b3b33563fe74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fe6d expref: 17 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432739.084596:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850a00, rc 0) 00000100:00100000:1.0:1787432739.084663:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17151:x1874258609488896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432739.084670:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787432739.085625:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609488896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432739.085658:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484032e5800/0xca72b3b33563fe6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe74 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432739.085668:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484032e5800/0xca72b3b33563fe6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fe74 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432739.085739:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609489024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787432739.085785:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432739.085841:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841223b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432739.085998:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609489024 00000100:00100000:1.0:1787432739.086004:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609489024 00000100:00100000:1.0:1787432739.086049:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787432739.086058:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17151:x1874258609489024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787432739.086084:0:17149:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787432739.086097:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787432739.086100:0:17149:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787432739.086206:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17151:x1874258609489024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 149us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432739.086213:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787432739.086415:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609489024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787432739.086456:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787432739.086464:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5800/0xca72b3b33563fe6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe74 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432739.086472:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484032e5800/0xca72b3b33563fe6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe74 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432739.086482:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787432739.086484:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9483038e1000 from 8 10000000:01000000:2.0:1787432739.086487:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787432739.086508:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563fe7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432739.086526:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563fe7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432739.086545:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563fe7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432739.086558:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609489152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787432739.086807:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432739.086847:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841223b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432739.086899:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609489152 00000100:00100000:1.0:1787432739.086904:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609489152 00000100:00100000:1.0:1787432739.086940:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787432739.086948:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17151:x1874258609489152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432739.086956:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432739.086967:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303851200/0xca72b3b33563fe82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fe7b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432739.086985:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303851200/0xca72b3b33563fe82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fe7b expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432739.086993:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303851200/0xca72b3b33563fe82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fe7b expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432739.087001:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851200, rc 0) 00000100:00100000:1.0:1787432739.087037:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17151:x1874258609489152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432739.087045:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787432739.088128:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609489152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432739.088150:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563fe7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe82 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432739.088161:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563fe7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fe82 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432739.088256:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609489280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787432739.088309:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432739.088347:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841223b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432739.089113:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609489280 00000100:00100000:0.0:1787432739.089122:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609489280 00000100:00100000:0.0:1787432739.089193:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787432739.089203:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948420e41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17151:x1874258609489280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787432739.089232:0:17148:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787432739.089245:0:17148:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787432739.089248:0:17148:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787432739.089343:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948420e41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17151:x1874258609489280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432739.089350:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787432739.089409:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609489280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787432739.089458:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787432739.089466:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563fe7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe82 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432739.089475:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563fe7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe82 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787432739.405591:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787432739.470209:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00010000:00010000:3.0:1787432739.984294:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432740.495946:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787432741.007927:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432741.515821:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 0 seconds 00010000:00010000:3.0:1787432742.027398:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432742.352044:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609489408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432742.352120:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432742.352259:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609489408 00000100:00100000:0.0:1787432742.352267:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609489408 00000100:00100000:0.0:1787432742.352322:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787432742.352332:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609489408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432742.352365:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787432742.352417:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609489408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432742.352424:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787432742.352467:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609489408:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1787432742.352509:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787432742.352514:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787432742.352527:0:36:0:(import.c:65:import_set_state_nolock()) ffff948409d2f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432742.352535:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff948409d2f000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432742.352558:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948303909880 x1874258609489664/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432742.352613:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432742.352700:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432742.352703:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432742.352706:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432742.352729:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432742.352732:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432742.352734:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432742.352736:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787432742.352756:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609489536:0@lo:400:kworker.0 00000100:00100000:0.0:1787432742.352796:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432742.352829:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609489664:0@lo:38:kworker.0 00000100:00100000:0.0:1787432742.352922:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432742.352949:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609489792:0@lo:400:kworker.0 00000100:00100000:0.0:1787432742.352974:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432742.352994:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432742.352999:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609489920:0@lo:400:kworker.0 00000100:00100000:0.0:1787432742.353017:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432742.353044:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609489536 00000100:00100000:0.0:1787432742.353048:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609489536 00000100:00100000:0.0:1787432742.353083:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787432742.353089:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:3642:x1874258609489536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432742.353126:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:3642:x1874258609489536:12345-0@lo:400:kworker.0 Request processed in 37us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432742.353133:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787432742.353159:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609489664 00000100:00100000:0.0:1787432742.356329:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609489664 00000100:00100000:0.0:1787432742.356404:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787432742.356414:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1874258609489664:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787432742.356449:0:17160:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:0.0:1787432742.356491:0:17160:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b33563fe89 00000004:00100000:0.0:1787432742.356509:0:17160:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787432742.356514:0:17160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1787432742.360079:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609489792 00000100:00100000:0.0:1787432742.360096:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609489792 00000100:00100000:0.0:1787432742.360186:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609489920 00000100:00100000:0.0:1787432742.360190:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609489920 00000100:00100000:0.0:1787432742.360214:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432742.360224:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609489792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432742.360320:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609489792:12345-0@lo:400:kworker.0 Request processed in 97us (7343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432742.360329:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432742.360347:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432742.360354:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609489920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432742.360383:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609489920:12345-0@lo:400:kworker.0 Request processed in 29us (7364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432742.360390:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432742.360560:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609489536:0@lo:400:kworker.0 00010000:00080000:0.0:1787432742.360600:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94830390ad80 x1874258609489920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432742.360612:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609489920:0@lo:400:kworker.0 00010000:00080000:0.0:1787432742.360826:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948303908380 x1874258609489792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432742.360907:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609489792:0@lo:400:kworker.0 00000100:00080000:1.0:1787432742.376263:0:17160:0:(import.c:65:import_set_state_nolock()) ffff948434d98800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432742.376414:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1874258609489664:12345-0@lo:38:kworker.0 Request processed in 19997us (23489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432742.376436:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787432742.380508:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787432742.380523:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787432742.380529:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787432742.380533:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948409d2f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1787432742.380553:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ca9ec17e): req@ffff9484348dce00 x1874258609482240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432742.380575:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609489664:0@lo:38:kworker.0 00000100:00100000:0.0:1787432742.380684:0:17195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432742.380714:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484335afcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432742.380732:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609482240 00000100:00100000:0.0:1787432742.380738:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609482240 00000100:00100000:0.0:1787432742.380793:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787432742.380801:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17195:x1874258609482240:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787432742.380888:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17195:x1874258609482240:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 87us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432742.380895:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787432742.380929:0:17195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dce00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17195:1874258609482240:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1787432742.380977:0:17195:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787432742.381020:0:17195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17195:1874258609490048:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787432742.381049:0:17195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432742.381073:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb110c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432742.381087:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609490048 00000100:00100000:0.0:1787432742.381091:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609490048 00000100:00100000:0.0:1787432742.381113:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787432742.381120:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17195:x1874258609490048:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787432742.381237:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17195:x1874258609490048:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 117us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432742.381243:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787432742.381270:0:17195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17195:1874258609490048:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787432742.381332:0:17195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17195:1874258609490176:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787432742.381354:0:17195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432742.381367:0:17195:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb110c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432742.381378:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609490176 00000100:00100000:0.0:1787432742.381381:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609490176 00000100:00100000:0.0:1787432742.381403:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787432742.381409:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17195:x1874258609490176:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787432742.381453:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17195:x1874258609490176:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 44us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432742.381459:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787432742.381480:0:17195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17195:1874258609490176:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1787432742.381515:0:17195:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787432742.383502:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609490304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432742.383561:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432742.383615:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609490304 00000100:00100000:3.0:1787432742.383621:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609490304 00000100:00100000:3.0:1787432742.383664:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787432742.383673:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609490304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787432742.383704:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787432742.383750:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609490304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432742.383757:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787432742.383810:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609490304:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1787432742.386817:0:17195:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787432742.387373:0:17195:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:0.0:1787432742.387379:0:17195:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:3.0:1787432742.557438:0:18155:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787432743.052277:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787432743.646340:0:18207:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787432743.649124:0:18207:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787432744.075548:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787432744.530599:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1787432744.770874:0:18258:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787432744.773919:0:18258:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787432745.099424:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787432745.830235:0:18306:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc238b93d0 20000000:00000080:2.0:1787432745.830253:0:18306:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94843688fc00 uarg=0000000000000000 20000000:01000000:2.0:1787432745.830305:0:18306:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787432745.830312:0:18306:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787432745.830317:0:18306:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787432745.832845:0:18307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1787432745.833108:0:18306:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787432745.848678:0:18306:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787432745.850600:0:18306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948304489800/0xca72b3b33563fe90 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.850703:0:18306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9483039f0200/0xca72b3b33563fd39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fd32 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.850712:0:18306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484032e4200/0xca72b3b33563fe3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fe35 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.850721:0:18306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948304489800/0xca72b3b33563fe90 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.850766:0:18306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484032e4200/0xca72b3b33563fe3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563fe35 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.850783:0:18306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9484032e4200/0xca72b3b33563fe3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563fe35 expref: 17 pid: 17147 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432745.850799:0:18306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18306:1874258609490432:0@lo:104: 00000100:00100000:0.0:1787432745.850993:0:18306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432745.851199:0:18306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9483039f0200/0xca72b3b33563fd39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563fd32 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.851209:0:18306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9483039f0200/0xca72b3b33563fd39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563fd32 expref: 17 pid: 17147 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432745.851237:0:18306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18306:1874258609490560:0@lo:104: 00000100:00100000:0.0:1787432745.851260:0:18306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432745.852142:0:18306:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484067daa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432745.852312:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609490432 00000100:00100000:1.0:1787432745.852322:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609490432 00000100:00100000:3.0:1787432745.852392:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609490560 00000100:00100000:3.0:1787432745.852398:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609490560 00000100:00100000:3.0:1787432745.852428:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432745.852438:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+4:18306:x1874258609490432:12345-0@lo:104: 00010000:00010000:3.0:1787432745.852454:0:17137:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fe35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563fe3c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432745.852586:0:17137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787432745.852594:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+4:18306:x1874258609490432:12345-0@lo:104: Request processed in 157us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432745.852602:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432745.852621:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787432745.852627:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+3:18306:x1874258609490560:12345-0@lo:104: 00010000:00010000:3.0:1787432745.852636:0:17137:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948303851600/0xca72b3b33563fd32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563fd39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432745.852682:0:17137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787432745.852687:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+3:18306:x1874258609490560:12345-0@lo:104: Request processed in 61us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432745.852704:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787432745.852732:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787432745.852740:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fe35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563fe3c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.852747:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1787432745.852752:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fe35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563fe3c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.852761:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fe35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563fe3c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432745.852769:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fe35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563fe3c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432745.852775:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787432745.852869:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fe35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fe3c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.852875:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432745.852897:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fe35 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fe3c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.852905:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fe35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fe3c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.852919:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432745.852936:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948303851600/0xca72b3b33563fd32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563fd39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.852942:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1787432745.852945:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948303851600/0xca72b3b33563fd32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563fd39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.852951:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948303851600/0xca72b3b33563fd32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563fd39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432745.852956:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948303851600/0xca72b3b33563fd32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563fd39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432745.852961:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787432745.853053:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432745.853281:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948303851600/0xca72b3b33563fd32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fd39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.853288:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432745.853304:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948303851600/0xca72b3b33563fd32 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fd39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.853311:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948303851600/0xca72b3b33563fd32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fd39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.853324:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432745.853325:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432745.853327:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432745.853340:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609490688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432745.853398:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432745.853579:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609490816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432745.853622:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432745.853917:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609490688 00000100:00100000:0.0:1787432745.853934:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609490688 00010000:00010000:0.0:1787432745.853959:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484032e4200/0xca72b3b33563fe3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fe35 expref: 18 pid: 17147 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432745.853991:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609490816 00000100:00100000:0.0:1787432745.853995:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609490816 00010000:00010000:0.0:1787432745.854006:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9483039f0200/0xca72b3b33563fd39 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fd32 expref: 19 pid: 17147 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432745.854019:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432745.854037:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+19:3642:x1874258609490688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432745.854049:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432745.854054:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484032e4200/0xca72b3b33563fe3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fe35 expref: 19 pid: 17147 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.854066:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484032e4200/0xca72b3b33563fe3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563fe35 expref: 19 pid: 17147 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.854083:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432745.854117:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+19:3642:x1874258609490688:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432745.854124:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432745.854141:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432745.854147:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304644380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:3643:x1874258609490816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432745.854154:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432745.854158:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9483039f0200/0xca72b3b33563fd39 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fd32 expref: 18 pid: 17147 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.854188:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9483039f0200/0xca72b3b33563fd39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563fd32 expref: 18 pid: 17147 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.854211:0:17141:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948304489800/0xca72b3b33563fe90 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.854219:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948304489800/0xca72b3b33563fe90 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.854235:0:17141:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948304489800/0xca72b3b33563fe90 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.854242:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948304489800/0xca72b3b33563fe90 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.854248:0:17141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948304489800/0xca72b3b33563fe90 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.854255:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948304489800/0xca72b3b33563fe90 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.854261:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489800 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432745.854266:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948304489800/0xca72b3b33563fe90 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.854273:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948304489800/0xca72b3b33563fe90 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.854281:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948304489800/0xca72b3b33563fe90 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432745.854291:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432745.854322:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304644380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:3643:x1874258609490816:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432745.854337:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432745.854386:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609490688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432745.854423:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609490816:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432745.857913:0:18306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e4200/0xca72b3b33563fe3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563fe35 expref: 17 pid: 17147 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432745.857934:0:18306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18306:1874258609490432:0@lo:104: 00010000:00010000:2.0:1787432745.857949:0:18306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9483039f0200/0xca72b3b33563fd39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563fd32 expref: 16 pid: 17147 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432745.857964:0:18306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18306:1874258609490560:0@lo:104: 00010000:00010000:2.0:1787432745.857995:0:18306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948304489800/0xca72b3b33563fe90 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432745.858005:0:18306:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948304489800/0xca72b3b33563fe90 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432745.858011:0:18306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948304489800/0xca72b3b33563fe90 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432745.858017:0:18306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948304489800/0xca72b3b33563fe90 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432746.123337:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432746.451468:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432731/real 1787432731] req@ffff94830379aa00 x1874258609483264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432746 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432746.451502:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94830379aa00 x1874258609483264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432746 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432746.451732:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432731/real 1787432731] req@ffff94830379a680 x1874258609483392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432746 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432746.451754:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94830379a680 x1874258609483392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432746 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787432746.451797:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484166d0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787432746.451823:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787432746.451828:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609483264:0@lo:8:kworker.0 00000100:00080000:2.0:1787432746.451833:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484034a6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787432746.451838:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787432746.451842:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609483392:0@lo:8:kworker.0 00000100:00080000:3.0:1787432746.452088:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432746.452100:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787432746.452103:0:8:0:(import.c:65:import_set_state_nolock()) ffff9484166d0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432746.452108:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 542 00000100:00080000:3.0:1787432746.452113:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787432746.452120:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9484166d0800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432746.452142:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948303798380 x1874258609491200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432746.452158:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432746.452161:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787432746.452185:0:8:0:(import.c:65:import_set_state_nolock()) ffff9484034a6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432746.452189:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 542 00000100:00080000:3.0:1787432746.452192:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787432746.452196:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9484034a6800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432746.452208:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94830379a300 x1874258609491328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432746.452236:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432746.452240:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787432746.452242:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432746.452246:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787432746.452271:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609491200:0@lo:8:kworker.0 00000400:00000100:3.0:1787432746.452322:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258609491200 offset 0 length 520: 4 00000100:00100000:3.0:1787432746.452359:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609491328:0@lo:8:kworker.0 00000400:00000100:3.0:1787432746.452390:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258609491328 offset 0 length 520: 4 00000100:00100000:2.0:1787432746.452470:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3644:1874258609490944:0@lo:400:kworker.0 00000100:00100000:2.0:1787432746.452513:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432746.452556:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609491712:0@lo:400:kworker.0 00000100:00100000:2.0:1787432746.452589:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432746.452611:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432746.452618:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609491584:0@lo:400:kworker.0 00000100:00100000:2.0:1787432746.452705:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432746.452911:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609490944 00000100:00100000:3.0:1787432746.452919:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609490944 00000100:00100000:3.0:1787432746.452978:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787432746.452990:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+16:3644:x1874258609490944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432746.453048:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+16:3644:x1874258609490944:12345-0@lo:400:kworker.0 Request processed in 60us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432746.453056:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787432746.453091:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609491584 00000100:00100000:3.0:1787432746.453095:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609491584 00000100:00100000:3.0:1787432746.453123:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787432746.453131:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609491584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432746.453194:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609491584:12345-0@lo:400:kworker.0 Request processed in 65us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432746.453201:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787432746.453256:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609491584:0@lo:400:kworker.0 00000100:00100000:3.0:1787432746.453268:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3644:1874258609490944:0@lo:400:kworker.0 00000100:00100000:0.0:1787432746.454479:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609491072:0@lo:400:kworker.0 00000100:00100000:0.0:1787432746.454533:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432746.454572:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432746.454579:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609491456:0@lo:400:kworker.0 00000100:00100000:1.0:1787432746.454595:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609491072 00000100:00100000:1.0:1787432746.454600:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609491072 00000100:00100000:0.0:1787432746.454606:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432746.454642:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609491712 00000100:00100000:0.0:1787432746.454646:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609491712 00000100:00100000:0.0:1787432746.454677:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609491456 00000100:00100000:0.0:1787432746.454680:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609491456 00000100:00100000:0.0:1787432746.454711:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432746.454718:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609491712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432746.454780:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609491712:12345-0@lo:400:kworker.0 Request processed in 62us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432746.454786:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432746.454807:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787432746.454814:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609491456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432746.454854:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609491456:12345-0@lo:400:kworker.0 Request processed in 42us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432746.454861:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787432746.454905:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94830379a680 x1874258609491456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432746.454921:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609491456:0@lo:400:kworker.0 00010000:00080000:0.0:1787432746.454981:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94830379bb80 x1874258609491712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432746.454991:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609491712:0@lo:400:kworker.0 00000100:00100000:1.0:1787432746.455161:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787432746.455190:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609491072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432746.455236:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609491072:12345-0@lo:400:kworker.0 Request processed in 49us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432746.455301:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787432746.455523:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609491072:0@lo:400:kworker.0 10000000:01000000:3.0:1787432747.019644:0:17151:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787432747.019653:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94843f837000 from 13 10000000:01000000:3.0:1787432747.019658:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787432747.019719:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f1a00/0xca72b3b33563fe97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432747.019730:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9483039f1a00/0xca72b3b33563fe97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432747.019740:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9483039f1a00/0xca72b3b33563fe97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432747.019788:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609491840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432747.019857:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432747.019952:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484126b6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787432747.023250:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609491840 00000100:00100000:0.0:1787432747.023265:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609491840 00000100:00100000:1.0:1787432747.026831:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787432747.026846:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+16:17151:x1874258609491840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432747.026865:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432747.026885:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303850c00/0xca72b3b33563fe9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fe97 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432747.026912:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303850c00/0xca72b3b33563fe9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fe97 expref: 17 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432747.026923:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303850c00/0xca72b3b33563fe9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fe97 expref: 17 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432747.026951:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850c00, rc 0) 00000100:00100000:1.0:1787432747.027039:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17151:x1874258609491840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (7181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432747.027046:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787432747.027135:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609491840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432747.027155:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9483039f1a00/0xca72b3b33563fe97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe9e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432747.027181:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9483039f1a00/0xca72b3b33563fe97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fe9e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432747.027255:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609491968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432747.027289:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432747.031087:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037ea000 going to sleep for 11 seconds 00000100:00100000:3.0:1787432747.031182:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609491968 00000100:00100000:3.0:1787432747.031191:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609491968 00000100:00100000:3.0:1787432747.031245:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787432747.031256:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17151:x1874258609491968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432747.038264:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17151:x1874258609491968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6999us (10964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432747.038281:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787432747.040751:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609491968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432747.040826:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609492096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432747.042098:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432747.043363:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037ea000 going to sleep for 11 seconds 00000100:00100000:2.0:1787432747.043521:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609492096 00000100:00100000:2.0:1787432747.043531:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609492096 00000100:00100000:2.0:1787432747.043715:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787432747.043727:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17151:x1874258609492096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432747.043883:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17151:x1874258609492096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432747.043891:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787432747.043994:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609492096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787432747.045877:0:18368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787432747.046580:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787432747.046687:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787432747.046699:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f1a00/0xca72b3b33563fe97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe9e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432747.046710:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9483039f1a00/0xca72b3b33563fe97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fe9e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432747.046721:0:17151:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787432747.046724:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9483038e1000 from 13 10000000:01000000:3.0:1787432747.046727:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787432747.046770:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f1800/0xca72b3b33563fea5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432747.046778:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9483039f1800/0xca72b3b33563fea5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432747.046788:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9483039f1800/0xca72b3b33563fea5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432747.046824:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609492224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432747.046883:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432747.047047:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484126b6900 going to sleep for 11 seconds 00000100:00100000:2.0:1787432747.048975:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609492224 00000100:00100000:2.0:1787432747.048987:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609492224 00000100:00100000:2.0:1787432747.049268:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787432747.049280:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+17:17151:x1874258609492224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432747.049319:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432747.049337:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484032e5e00/0xca72b3b33563feac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fea5 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432747.049376:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e5e00/0xca72b3b33563feac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fea5 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432747.049549:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484032e5e00/0xca72b3b33563feac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fea5 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432747.049558:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e5e00, rc 0) 00000100:00100000:2.0:1787432747.049730:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17151:x1874258609492224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 452us (2845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432747.049737:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787432747.049832:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609492224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432747.049850:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9483039f1800/0xca72b3b33563fea5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563feac expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432747.049859:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9483039f1800/0xca72b3b33563fea5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563feac expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432747.049945:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609492352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432747.049979:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432747.050536:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484126b6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787432747.050701:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609492352 00000100:00100000:1.0:1787432747.050708:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609492352 00000100:00100000:1.0:1787432747.050745:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787432747.050755:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17151:x1874258609492352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432747.050886:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17151:x1874258609492352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432747.050894:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787432747.051122:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609492352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432747.051161:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609492480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432747.051226:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432747.051248:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484126b6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787432747.051470:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609492480 00000100:00100000:1.0:1787432747.051475:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609492480 00000100:00100000:1.0:1787432747.051498:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787432747.051505:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17151:x1874258609492480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432747.051605:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:17151:x1874258609492480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432747.051615:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787432747.051762:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609492480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787432747.052970:0:18369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787432747.053154:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787432747.053486:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787432747.053498:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f1800/0xca72b3b33563fea5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563feac expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432747.053737:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9483039f1800/0xca72b3b33563fea5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563feac expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432747.147311:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432747.472447:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609492608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432747.472530:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432747.472844:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609492608 00000100:00100000:3.0:1787432747.472853:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609492608 00000100:00100000:3.0:1787432747.472898:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787432747.472907:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609492608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787432747.472940:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787432747.473035:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609492608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432747.473042:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787432747.473089:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609492608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432747.473717:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432747.473730:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609492736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432747.473770:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432747.473804:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609492736 00000100:00100000:3.0:1787432747.473808:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609492736 00000100:00100000:3.0:1787432747.473839:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787432747.473848:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609492736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787432747.473871:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787432747.473906:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609492736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432747.473912:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787432747.473943:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609492736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432747.475455:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432737/real 1787432737] req@ffff948303908700 x1874258609485824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432747 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432747.475485:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948303908700 x1874258609485824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432747 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432747.475494:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432737/real 1787432737] req@ffff9484348dc380 x1874258609485696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432747 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432747.475504:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9484348dc380 x1874258609485696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432747 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787432747.475520:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432747.475534:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787432747.475537:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609485824:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787432747.475542:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948434887000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432747.475547:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787432747.475550:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609485696:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787432747.477650:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432747.477659:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787432747.477672:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432747.477692:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787432747.477742:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432747.477746:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787432747.477750:0:8:0:(import.c:65:import_set_state_nolock()) ffff948434887000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432747.477757:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 548 00000100:00080000:3.0:1787432747.477762:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787432747.477768:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff948434887000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432747.477790:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948303799180 x1874258609492992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432747.477805:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432747.477807:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787432747.477809:0:8:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432747.477812:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 548 00000100:00080000:3.0:1787432747.477814:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787432747.477817:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94843c7f3800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:3.0:1787432747.477828:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948303799880 x1874258609493120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432747.477859:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609493248:0@lo:400:kworker.0 00000100:00100000:3.0:1787432747.477926:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432747.477963:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432747.477968:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609492864:0@lo:400:kworker.0 00000100:00100000:3.0:1787432747.477987:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432747.478014:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609493248 00000100:00100000:3.0:1787432747.478020:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609493248 00000100:00100000:3.0:1787432747.478058:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609492864 00000100:00100000:3.0:1787432747.478067:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609492864 00000100:00100000:3.0:1787432747.478086:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432747.478093:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609493248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432747.478144:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609493248:12345-0@lo:400:kworker.0 Request processed in 50us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432747.478151:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432747.478196:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787432747.478203:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609492864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432747.478231:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609492864:12345-0@lo:400:kworker.0 Request processed in 29us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432747.478236:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787432747.478273:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948303798700 x1874258609492864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432747.478285:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609492864:0@lo:400:kworker.0 00010000:00080000:3.0:1787432747.478294:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94830379b100 x1874258609493248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432747.478301:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609493248:0@lo:400:kworker.0 00000100:00100000:3.0:1787432747.478322:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609492992:0@lo:8:kworker.0 00000400:00000100:3.0:1787432747.478344:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258609492992 offset 0 length 520: 4 00000100:00100000:3.0:1787432747.478364:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609493120:0@lo:8:kworker.0 00000400:00000100:3.0:1787432747.478381:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258609493120 offset 0 length 520: 4 00000001:00100000:1.0:1787432747.983717:0:17886:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787432748.171340:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432749.195411:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787432749.644603:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787432750.219369:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432751.245993:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432752.269467:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787432752.587904:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432752.587911:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787432752.587920:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432752.587923:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787432752.587947:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432752.587951:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787432752.587953:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432752.587955:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787432752.588014:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3641:1874258609493376:0@lo:400:kworker.0 00000100:00100000:3.0:1787432752.588080:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432752.588122:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609493888:0@lo:400:kworker.0 00000100:00100000:3.0:1787432752.588147:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432752.588190:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787432752.588197:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609493504:0@lo:400:kworker.0 00000100:00100000:3.0:1787432752.588222:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432752.588241:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609494016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432752.588263:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432752.588287:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609493760:0@lo:400:kworker.0 00000100:00100000:3.0:1787432752.588309:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432752.588323:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432752.588328:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609493632:0@lo:400:kworker.0 00000100:00100000:3.0:1787432752.588350:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432752.588376:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609493888 00000100:00100000:3.0:1787432752.588383:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609493888 00000100:00100000:3.0:1787432752.588423:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609493632 00000100:00100000:3.0:1787432752.588426:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609493632 00000100:00100000:1.0:1787432752.588789:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609493376 00000100:00100000:1.0:1787432752.588794:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609493376 00000100:00100000:1.0:1787432752.588864:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787432752.588875:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:3641:x1874258609493376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432752.588936:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:3641:x1874258609493376:12345-0@lo:400:kworker.0 Request processed in 62us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432752.588944:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787432752.589006:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3641:1874258609493376:0@lo:400:kworker.0 00000100:00100000:3.0:1787432752.589325:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787432752.589331:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609493888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432752.589370:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609493888:12345-0@lo:400:kworker.0 Request processed in 39us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432752.589377:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787432752.589389:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787432752.589396:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609493632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432752.589428:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609493632:12345-0@lo:400:kworker.0 Request processed in 32us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432752.589445:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787432752.589464:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609493504 00000100:00100000:3.0:1787432752.589468:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609493504 00000100:00100000:3.0:1787432752.589485:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609494016 00000100:00100000:3.0:1787432752.589488:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609494016 00000100:00100000:3.0:1787432752.589497:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609493760 00000100:00100000:3.0:1787432752.589499:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609493760 00000100:00100000:3.0:1787432752.589510:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787432752.589639:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609493504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432752.589675:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609493504:12345-0@lo:400:kworker.0 Request processed in 159us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432752.589681:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787432752.589693:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787432752.589699:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1874258609494016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787432752.589723:0:17160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787432752.589762:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1874258609494016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432752.589768:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787432752.589788:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787432752.589794:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609493760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432752.589823:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609493760:12345-0@lo:400:kworker.0 Request processed in 30us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432752.589829:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787432752.589873:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948303798e00 x1874258609493632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432752.589886:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609493632:0@lo:400:kworker.0 00000100:00100000:3.0:1787432752.589896:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609493760:0@lo:400:kworker.0 00000100:00100000:1.0:1787432752.591852:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609493504:0@lo:400:kworker.0 00000100:00100000:1.0:1787432752.591877:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609494016:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1787432752.591894:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff948303798000 x1874258609493888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432752.591904:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609493888:0@lo:400:kworker.0 00000100:00100000:0.0:1787432752.592698:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609494144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432752.592771:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432752.592828:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609494144 00000100:00100000:0.0:1787432752.592834:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609494144 00000100:00100000:0.0:1787432752.592874:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787432752.592884:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609494144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432752.592915:0:17160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787432752.592969:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609494144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432752.592975:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787432752.593013:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609494144:0@lo:41:osp-pre-1-0.0 00000020:01000004:3.0:1787432752.893480:0:18654:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787432752.893485:0:18654:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787432752.893486:0:18654:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787432752.893618:0:18654:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff948301dc6000 00000020:01000004:3.0:1787432752.893636:0:18654:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787432752.893653:0:18654:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787432752.893670:0:18654:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9483030f4d28) 00000020:00000080:3.0:1787432752.893689:0:18654:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787432752.998457:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787432753.012330:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787432753.012998:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787432753.016317:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787432753.017199:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787432753.017521:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787432753.018194:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1787432753.019615:0:18654:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787432753.020020:0:18654:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787432753.020035:0:18654:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787432753.020048:0:18654:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xca72b3b33563feba 00000020:01000004:3.0:1787432753.020056:0:18654:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787432753.020078:0:18654:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.124@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787432753.020081:0:18654:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787432753.020093:0:18654:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787432753.020099:0:18654:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787432753.020111:0:18654:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9484093b3370) 00000020:00000080:3.0:1787432753.020125:0:18654:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1787432753.023564:0:18654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432753.025958:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787432753.025971:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787432753.027917:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787432753.027929:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787432753.031845:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787432753.031864:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787432753.034975:0:18654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787432753.035361:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787432753.035370:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787432753.036012:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787432753.036020:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787432753.064888:0:18654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787432753.065141:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787432753.065148:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787432753.076887:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787432753.076904:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787432753.090000:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787432753.090020:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787432753.100754:0:18654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787432753.101200:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787432753.101207:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787432753.106150:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787432753.106195:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787432753.162324:0:18654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432753.162826:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787432753.162835:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787432753.164793:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787432753.164808:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787432753.168539:0:18654:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787432753.168582:0:18654:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787432753.168589:0:18654:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.124@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787432753.198426:0:18654:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.124@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787432753.198475:0:18654:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.124@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787432753.198480:0:18654:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787432753.198482:0:18654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787432753.198488:0:18654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432753.198489:0:18654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432753.198490:0:18654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432753.198491:0:18654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432753.198493:0:18654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787432753.198495:0:18654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432753.198496:0:18654:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787432753.198500:0:18654:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787432753.198501:0:18654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787432753.198515:0:18654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787432753.198516:0:18654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432753.198517:0:18654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432753.198518:0:18654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432753.198519:0:18654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432753.198520:0:18654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787432753.198520:0:18654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432753.198521:0:18654:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787432753.198561:0:18654:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787432753.198582:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609494272:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787432753.198655:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432753.198769:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484126b66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432753.199242:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609494272 00000100:00100000:0.0:1787432753.199262:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609494272 00000100:00100000:0.0:1787432753.199321:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787432753.199330:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:18654:x1874258609494272:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787432753.199372:0:17149:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787432753.199375:0:17149:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787432753.199379:0:17149:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787432753.200421:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:18654:x1874258609494272:12345-0@lo:253:mount.lustre.0 Request processed in 1089us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432753.200432:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787432753.200526:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609494272:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787432753.200539:0:18654:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787432753.200542:0:18654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787432753.200544:0:18654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787432753.200545:0:18654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432753.200546:0:18654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432753.200548:0:18654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432753.200558:0:18654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432753.200560:0:18654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787432753.200562:0:18654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432753.200563:0:18654:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787432753.200581:0:18654:0:(tgt_mount.c:101:server_register_mount()) register mount ffff948301dc6000 from lustre-OST0000 10000000:01000000:2.0:1787432753.200608:0:18654:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787432753.200610:0:18654:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787432753.200617:0:18654:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9483030f0000 local copy 00010000:00010000:2.0:1787432753.200626:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432753.200877:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609494400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432753.200909:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432753.200942:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112cfb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432753.201002:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609494400 00000100:00100000:1.0:1787432753.201007:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609494400 00000100:00100000:1.0:1787432753.201151:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787432753.201159:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:18654:x1874258609494400:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432753.201409:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:18654:x1874258609494400:12345-0@lo:501:mount.lustre.0 Request processed in 250us (498us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787432753.201416:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787432753.201483:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609494400:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787432753.201499:0:18654:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787432753.201581:0:18654:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787432753.201587:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432753.201596:0:18654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432753.201620:0:18654:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff948301dc6000 10000000:01000000:2.0:1787432753.201623:0:18654:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787432753.201628:0:18654:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787432753.201631:0:18654:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787432753.201635:0:18654:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787432753.201637:0:18654:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787432753.201657:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5c00/0xca72b3b33563fec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432753.201674:0:18654:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484032e5c00/0xca72b3b33563fec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432753.201796:0:18654:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484032e5c00/0xca72b3b33563fec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432753.201821:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609494528:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787432753.201849:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432753.201876:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112cfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432753.201923:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609494528 00000100:00100000:0.0:1787432753.201927:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609494528 00000100:00100000:0.0:1787432753.201957:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787432753.201963:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948418e9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+18:18654:x1874258609494528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432753.201972:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432753.201990:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948304489800/0xca72b3b33563fecf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fec8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432753.202009:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948304489800/0xca72b3b33563fecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fec8 expref: 19 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432753.202131:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948304489800/0xca72b3b33563fecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fec8 expref: 19 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432753.202140:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304489800, rc 0) 00000100:00100000:0.0:1787432753.202199:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948418e9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+19:18654:x1874258609494528:12345-0@lo:101:mount.lustre.0 Request processed in 236us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432753.202205:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787432753.202287:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609494528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432753.202300:0:18654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484032e5c00/0xca72b3b33563fec8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fecf expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432753.202309:0:18654:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484032e5c00/0xca72b3b33563fec8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fecf expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787432753.203644:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787432753.204658:0:18654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787432753.207835:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787432753.207891:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787432753.207907:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787432753.207920:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787432753.207933:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787432753.207946:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787432753.207972:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787432753.207978:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787432753.208159:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609494656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432753.208421:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432753.208500:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff948302715c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432753.208597:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609494656 00000100:00100000:2.0:1787432753.208605:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609494656 00000100:00100000:2.0:1787432753.208725:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787432753.208736:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948418e9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+19:18654:x1874258609494656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432753.208880:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948418e9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+19:18654:x1874258609494656:12345-0@lo:501:mount.lustre.0 Request processed in 145us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432753.208888:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787432753.208949:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609494656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432753.208982:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609494784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432753.209040:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432753.209584:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff948302715c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432753.209937:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609494784 00000100:00100000:0.0:1787432753.209945:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609494784 00000100:00100000:0.0:1787432753.209986:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787432753.209996:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948418e9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+19:18654:x1874258609494784:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432753.211313:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948418e9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+19:18654:x1874258609494784:12345-0@lo:503:mount.lustre.0 Request processed in 1313us (2267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432753.211325:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787432753.211494:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609494784:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787432753.212156:0:18654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787432753.212393:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609494912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432753.212449:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432753.212479:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff948302715b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432753.212628:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609494912 00000100:00100000:0.0:1787432753.212635:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609494912 00000100:00100000:0.0:1787432753.212838:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787432753.212850:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948418e9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+19:18654:x1874258609494912:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432753.213454:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948418e9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+19:18654:x1874258609494912:12345-0@lo:502:mount.lustre.0 Request processed in 604us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432753.213463:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787432753.213882:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609494912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787432753.214121:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787432753.214153:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787432753.214188:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787432753.214205:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787432753.214217:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787432753.214229:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787432753.214239:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787432753.214267:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787432753.214296:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787432753.214309:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787432753.214321:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787432753.214332:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787432753.214377:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609495040:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432753.214428:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432753.214468:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff948302715b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432753.215122:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609495040 00000100:00100000:0.0:1787432753.215130:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609495040 00000100:00100000:0.0:1787432753.215206:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787432753.215218:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948418e9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+19:18654:x1874258609495040:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432753.215356:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948418e9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+19:18654:x1874258609495040:12345-0@lo:502:mount.lustre.0 Request processed in 139us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432753.215371:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787432753.215932:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609495040:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787432753.216001:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1787432753.216024:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1787432753.220767:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787432753.220781:0:18671:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787432753.220793:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432753.220795:0:18671:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787432753.220805:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787432753.220823:0:18671:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff94843b95cd28) 00000020:00000080:2.0:1787432753.220852:0:18671:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787432753.220859:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787432753.220955:0:18671:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948301dc6000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787432753.220963:0:18671:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787432753.220970:0:18671:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xca72b3b33563fedd 00010000:00010000:0.0:1787432753.234097:0:18671:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1787432753.234814:0:18671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1787432753.236980:0:18671:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1787432753.240942:0:18671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787432753.240956:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432753.240963:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432753.240965:0:18671:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787432753.240976:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787432753.240979:0:18671:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1787432753.240980:0:18671:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787432753.240982:0:18671:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787432753.240984:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787432753.240986:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432753.240987:0:18671:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787432753.240990:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432753.240993:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432753.240994:0:18671:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787432753.240997:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787432753.240999:0:18671:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787432753.241001:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432753.241002:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432753.241004:0:18671:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787432753.241006:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432753.241007:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432753.241009:0:18671:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787432753.241022:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787432753.241051:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432753.241054:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432753.241056:0:18671:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787432753.241059:0:18671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1787432753.241357:0:18654:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787432753.241388:0:18654:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787432753.241412:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5c00/0xca72b3b33563fec8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fecf expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432753.241424:0:18654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484032e5c00/0xca72b3b33563fec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fecf expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432753.241432:0:18654:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948301dc6000 from 1 10000000:01000000:0.0:1787432753.241435:0:18654:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787432753.241469:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fee4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432753.241476:0:18654:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fee4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432753.241485:0:18654:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fee4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432753.241519:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609495168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787432753.241597:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432753.241648:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037ead80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432753.241901:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609495168 00000100:00100000:2.0:1787432753.241909:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609495168 00000100:00100000:2.0:1787432753.241960:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787432753.241971:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948418e9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+19:18654:x1874258609495168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432753.241983:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432753.241996:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484032e4800/0xca72b3b33563feeb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fee4 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432753.242038:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e4800/0xca72b3b33563feeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fee4 expref: 20 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432753.242049:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484032e4800/0xca72b3b33563feeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fee4 expref: 20 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432753.242057:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e4800, rc 0) 00000100:00100000:2.0:1787432753.242100:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948418e9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:18654:x1874258609495168:12345-0@lo:101:mount.lustre.0 Request processed in 131us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432753.242107:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787432753.242378:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609495168:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432753.242393:0:18654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fee4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563feeb expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432753.242410:0:18654:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fee4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563feeb expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787432753.243841:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787432753.246006:0:18654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432753.249894:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787432753.249941:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787432753.249962:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787432753.249969:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787432753.250084:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609495296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432753.250150:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432753.250221:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483037ea3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432753.250498:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609495296 00000100:00100000:3.0:1787432753.250516:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609495296 00000100:00100000:3.0:1787432753.250578:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787432753.250588:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:18654:x1874258609495296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432753.250753:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:18654:x1874258609495296:12345-0@lo:501:mount.lustre.0 Request processed in 166us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432753.250761:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787432753.251421:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609495296:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432753.251463:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609495424:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432753.251524:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432753.251562:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff948302715b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432753.251914:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609495424 00000100:00100000:0.0:1787432753.251920:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609495424 00000100:00100000:0.0:1787432753.251968:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787432753.251977:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:18654:x1874258609495424:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432753.252083:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:18654:x1874258609495424:12345-0@lo:503:mount.lustre.0 Request processed in 107us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432753.252090:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787432753.252408:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609495424:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787432753.253128:0:18654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787432753.253233:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609495552:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432753.253432:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432753.253514:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff948302715b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432753.256648:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609495552 00000100:00100000:0.0:1787432753.256670:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609495552 00000100:00100000:1.0:1787432753.256838:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787432753.256849:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:18654:x1874258609495552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432753.257021:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:18654:x1874258609495552:12345-0@lo:502:mount.lustre.0 Request processed in 172us (3587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432753.257029:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787432753.257412:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304646d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609495552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787432753.257966:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787432753.258002:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787432753.258098:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787432753.258116:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787432753.258129:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787432753.258143:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787432753.258157:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787432753.258332:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1787432753.258350:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787432753.258364:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1787432753.258378:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1787432753.258430:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609495680:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432753.258484:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432753.258571:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112cfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432753.262898:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609495680 00000100:00100000:1.0:1787432753.262910:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609495680 00000100:00100000:1.0:1787432753.263028:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787432753.263038:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:18654:x1874258609495680:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432753.263214:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:18654:x1874258609495680:12345-0@lo:502:mount.lustre.0 Request processed in 177us (4729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432753.263223:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787432753.263332:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609495680:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787432753.263422:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787432753.263437:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787432753.267346:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432753.267359:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432753.267361:0:18675:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787432753.267368:0:18675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948301dc6000 00000020:00000080:3.0:1787432753.267370:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787432753.267379:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432753.267382:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432753.267383:0:18675:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787432753.267386:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432753.267388:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432753.267389:0:18675:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787432753.267400:0:18675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948301dc6000 00000020:00000080:3.0:1787432753.267402:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787432753.267453:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432753.272306:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432753.272313:0:18675:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787432753.272324:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432753.272331:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432753.272332:0:18675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787432753.272338:0:18675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948301dc6000 00000020:00000080:0.0:1787432753.272341:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787432753.272404:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432753.272408:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432753.272409:0:18675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787432753.272412:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432753.272415:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432753.272416:0:18675:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787432753.272420:0:18675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948301dc6000 00000020:00000080:0.0:1787432753.272422:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787432753.272462:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432753.272464:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432753.272466:0:18675:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787432753.272468:0:18675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1787432753.276804:0:18654:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787432753.276849:0:18654:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432753.278102:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fee4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563feeb expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432753.278126:0:18654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fee4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563feeb expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432753.278203:0:18654:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787432753.278206:0:18654:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff948301dc6000 10000000:01000000:2.0:1787432753.278210:0:18654:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff948301dc6000 10000000:01000000:2.0:1787432753.278214:0:18654:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787432753.278220:0:18654:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948301dc6000 from 1 10000000:01000000:2.0:1787432753.278222:0:18654:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787432753.278269:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563fef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432753.278277:0:18654:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563fef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432753.278287:0:18654:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563fef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432753.278310:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609495808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787432753.278371:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432753.278415:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112cfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432753.288132:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609495808 00000100:00100000:0.0:1787432753.288148:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609495808 00000100:00100000:0.0:1787432753.288216:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787432753.288226:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:18654:x1874258609495808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432753.288307:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432753.288327:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948304489e00/0xca72b3b33563fef9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563fef2 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432753.288357:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948304489e00/0xca72b3b33563fef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563fef2 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432753.288368:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948304489e00/0xca72b3b33563fef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fef2 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432753.288377:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304489e00, rc 0) 00000100:00100000:0.0:1787432753.288450:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:18654:x1874258609495808:12345-0@lo:101:mount.lustre.0 Request processed in 225us (10079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432753.288457:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787432753.290397:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609495808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432753.290426:0:18654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563fef2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fef9 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432753.290439:0:18654:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563fef2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563fef9 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432753.292174:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787432753.295635:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787432753.298853:0:18654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432753.300397:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787432753.300439:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787432753.300452:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787432753.300464:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787432753.300476:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787432753.300489:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787432753.301616:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787432753.301762:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787432753.301790:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787432753.301823:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787432753.301839:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787432753.301853:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787432753.301864:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787432753.301876:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787432753.301887:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787432753.301900:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787432753.301912:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787432753.301925:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787432753.301938:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787432753.301950:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787432753.301962:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787432753.301974:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787432753.301986:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787432753.301999:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787432753.302332:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1787432753.302365:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1787432753.302380:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1787432753.302393:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1787432753.302405:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1787432753.302428:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1787432753.302441:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1787432753.302453:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1787432753.302465:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1787432753.302478:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1787432753.302490:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1787432753.303093:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1787432753.303124:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1787432753.303152:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1787432753.303157:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787432753.304138:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609495936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432753.304654:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432753.309604:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112cfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432753.310790:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609495936 00000100:00100000:0.0:1787432753.310804:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609495936 00000100:00100000:0.0:1787432753.310855:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787432753.310866:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:18654:x1874258609495936:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432753.313654:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:18654:x1874258609495936:12345-0@lo:501:mount.lustre.0 Request processed in 2779us (8990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432753.313679:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787432753.315022:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609495936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432753.315085:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609496064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432753.315159:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432753.315224:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d319c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432753.315272:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609496064 00000100:00100000:0.0:1787432753.315278:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609496064 00000100:00100000:0.0:1787432753.315323:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787432753.315332:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:18654:x1874258609496064:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432753.315448:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:18654:x1874258609496064:12345-0@lo:503:mount.lustre.0 Request processed in 117us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432753.315455:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787432753.315511:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609496064:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787432753.315923:0:18654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787432753.315987:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609496192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432753.316023:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432753.316040:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484034f0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432753.316054:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609496192 00000100:00100000:0.0:1787432753.316058:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609496192 00000100:00100000:0.0:1787432753.316082:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787432753.316097:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:18654:x1874258609496192:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432753.316193:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:18654:x1874258609496192:12345-0@lo:502:mount.lustre.0 Request processed in 97us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432753.316200:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787432753.316242:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609496192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787432753.316384:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787432753.316408:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787432753.316420:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787432753.316431:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787432753.316444:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787432753.316456:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787432753.316468:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787432753.316480:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787432753.316492:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787432753.316503:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787432753.316514:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787432753.316526:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787432753.316538:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787432753.316563:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787432753.316578:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787432753.316588:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787432753.316598:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787432753.316609:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787432753.316621:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787432753.316633:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787432753.316644:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787432753.316656:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787432753.316667:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787432753.316681:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787432753.316692:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787432753.316728:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787432753.316743:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787432753.316756:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787432753.316768:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787432753.316781:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787432753.316792:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787432753.316803:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787432753.316816:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787432753.316828:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787432753.316840:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787432753.316852:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787432753.316865:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787432753.316878:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787432753.316889:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787432753.316901:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787432753.316914:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787432753.316941:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787432753.316956:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787432753.316970:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787432753.316985:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787432753.316998:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787432753.317010:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787432753.317021:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1787432753.317054:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609496320:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432753.317102:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432753.317138:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609496320 00000100:00100000:0.0:1787432753.317143:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609496320 00000100:00100000:0.0:1787432753.317190:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787432753.317197:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:18654:x1874258609496320:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432753.317270:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:18654:x1874258609496320:12345-0@lo:502:mount.lustre.0 Request processed in 73us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432753.317286:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787432753.317320:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484034f0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432753.317334:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609496320:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787432753.317453:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787432753.317470:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787432753.317487:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609496448:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432753.317515:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432753.317534:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609496448 00000100:00100000:0.0:1787432753.317538:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609496448 00000100:00100000:0.0:1787432753.317574:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787432753.317581:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:18654:x1874258609496448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432753.317636:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:18654:x1874258609496448:12345-0@lo:502:mount.lustre.0 Request processed in 55us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432753.317642:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787432753.317671:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484034f0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432753.317683:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609496448:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787432753.317715:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787432753.317723:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787432753.323920:0:18681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787432753.323938:0:18681:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff948433658000) 00000020:00000080:1.0:1787432753.323964:0:18681:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1787432753.324075:0:18681:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948301dc6000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787432753.324080:0:18681:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948301dc6000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787432753.324082:0:18681:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948301dc6000 3 00010000:00080000:1.0:1787432753.324121:0:18681:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948301d56000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.124@tcp at head 00010000:00010000:1.0:1787432753.330650:0:18681:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1787432753.333348:0:18681:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787432753.333408:0:18681:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787432753.333423:0:18681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xca72b3b33563ff07 00000100:00080000:1.0:1787432753.333435:0:18681:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787432753.333442:0:18681:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff948301d56000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432753.333476:0:18681:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948304644700 x1874258609496576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787432753.333584:0:18681:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787432753.334464:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432753.334470:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432753.334472:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432753.334476:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432753.334498:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432753.334577:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432753.334585:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432753.334588:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787432753.334629:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609497088:0@lo:400:kworker.0 00000100:00100000:0.0:1787432753.334760:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432753.334798:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432753.334805:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609496704:0@lo:400:kworker.0 00000100:00100000:0.0:1787432753.334833:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432753.334865:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609496832:0@lo:400:kworker.0 00000100:00100000:0.0:1787432753.334889:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432753.334905:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432753.334910:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609496960:0@lo:400:kworker.0 00000100:00100000:0.0:1787432753.334930:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432753.334965:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609497088 00000100:00100000:0.0:1787432753.334972:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609497088 00000100:00100000:0.0:1787432753.335007:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609496832 00000100:00100000:0.0:1787432753.335011:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609496832 00000100:00100000:0.0:1787432753.335025:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787432753.335034:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609497088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432753.335083:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609497088:12345-0@lo:400:kworker.0 Request processed in 50us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432753.335090:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787432753.335107:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787432753.335114:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609496832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432753.335144:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609496832:12345-0@lo:400:kworker.0 Request processed in 31us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432753.335158:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787432753.335205:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609496704 00000100:00100000:0.0:1787432753.335209:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609496704 00000100:00100000:0.0:1787432753.335230:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609496960 00000100:00100000:0.0:1787432753.335233:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609496960 00000100:00100000:0.0:1787432753.335374:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787432753.335384:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609496704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432753.335419:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609496704:12345-0@lo:400:kworker.0 Request processed in 38us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432753.335425:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787432753.339340:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874258609496576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787432753.339415:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432753.341217:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787432753.341237:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609496960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432753.341342:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609496960:12345-0@lo:400:kworker.0 Request processed in 113us (6409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432753.341350:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787432753.341406:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609496704:0@lo:400:kworker.0 00010000:00080000:0.0:1787432753.341424:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9484359eb800 x1874258609497088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432753.341435:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609497088:0@lo:400:kworker.0 00000100:00100000:0.0:1787432753.341472:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609496960:0@lo:400:kworker.0 00010000:00080000:0.0:1787432753.341485:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9484359e8700 x1874258609496832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432753.341493:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609496832:0@lo:400:kworker.0 00000100:00100000:0.0:1787432753.341818:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609496576 00000100:00100000:0.0:1787432753.341835:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609496576 00000100:00100000:0.0:1787432753.341865:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432753.341870:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874258609496576:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787432753.341893:0:17155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:0.0:1787432753.341927:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xca72b3b33563ff0e 00000004:00100000:0.0:1787432753.341940:0:17155:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787432753.341969:0:17155:0:(import.c:65:import_set_state_nolock()) ffff9483027d2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432753.342022:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874258609496576:12345-0@lo:38:llog_process_th.0 Request processed in 150us (2607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432753.342028:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787432753.342204:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948304644700 x1874258609496576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432753.342214:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787432753.342223:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787432753.342231:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787432753.342236:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787432753.342238:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948301d56000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787432753.342313:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1874258609496576:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1787432753.342779:0:18681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787432753.342794:0:18681:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff94843365b370) 00000020:00000080:1.0:1787432753.342814:0:18681:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1787432753.342888:0:18681:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948301dc6000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787432753.342892:0:18681:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948301dc6000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787432753.342895:0:18681:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948301dc6000 3 00010000:00080000:1.0:1787432753.342918:0:18681:0:(ldlm_lib.c:102:import_set_conn()) imp ffff948301d55800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.124@tcp at head 00010000:00010000:0.0:1787432753.348085:0:18681:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1787432753.349445:0:18681:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787432753.350352:0:18681:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787432753.350370:0:18681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xca72b3b33563ff1c 00000100:00080000:0.0:1787432753.350382:0:18681:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787432753.350389:0:18681:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff948301d55800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432753.350428:0:18681:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9484359e8700 x1874258609497216/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787432753.350482:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1874258609497216:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787432753.351471:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432753.351642:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609497216 00000100:00100000:0.0:1787432753.351651:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609497216 00000100:00100000:0.0:1787432753.352349:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432753.352359:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874258609497216:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787432753.352391:0:17155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:0.0:1787432753.352427:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xca72b3b33563ff23 00000004:00100000:0.0:1787432753.352450:0:17155:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787432753.352484:0:17155:0:(import.c:65:import_set_state_nolock()) ffff9483027d1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432753.353412:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874258609497216:12345-0@lo:38:llog_process_th.0 Request processed in 1049us (1940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432753.353424:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787432753.353483:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9484359e8700 x1874258609497216/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432753.353495:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787432753.354237:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787432753.354319:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787432753.354325:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787432753.354329:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948301d55800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787432753.354338:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1874258609497216:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787432753.354380:0:18681:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787432753.354748:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432753.354754:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787432753.354756:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432753.354772:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787432753.354776:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432753.354779:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787432753.354782:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432753.354785:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1787432753.359947:0:18681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1787432753.360099:0:18654:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787432753.360131:0:18654:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787432753.360155:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563fef2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fef9 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432753.360190:0:18654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484032e4e00/0xca72b3b33563fef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fef9 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787432753.360346:0:18654:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787432753.360349:0:18654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787432753.360351:0:18654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432753.360352:0:18654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432753.360353:0:18654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432753.360355:0:18654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432753.360356:0:18654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787432753.360358:0:18654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432753.360360:0:18654:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787432753.360363:0:18654:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787432753.360366:0:18654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787432753.360367:0:18654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787432753.360368:0:18654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432753.360369:0:18654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432753.360370:0:18654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432753.360372:0:18654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432753.360373:0:18654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787432753.360385:0:18654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432753.360386:0:18654:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787432753.360414:0:18654:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787432753.360435:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304647480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609497344:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787432753.360516:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432753.360799:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432753.361367:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609497344 00000100:00100000:0.0:1787432753.361375:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609497344 00000100:00100000:0.0:1787432753.361465:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787432753.361475:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:18654:x1874258609497344:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787432753.361513:0:17147:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787432753.361527:0:17147:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787432753.371488:0:17147:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787432753.371517:0:17147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787432753.371739:0:17170:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787432753.371744:0:17170:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787432753.371766:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9484032e5400/0xca72b3b33563ff2a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432753.371787:0:17170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948303850a00/0xca72b3b33563fe74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fe6d expref: 21 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432753.371795:0:17170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948303851200/0xca72b3b33563fe82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fe7b expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432753.371802:0:17170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9484032e5400/0xca72b3b33563ff2a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432753.371838:0:17170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948303851200/0xca72b3b33563fe82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563fe7b expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432753.371851:0:17170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948303851200/0xca72b3b33563fe82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563fe7b expref: 21 pid: 17147 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432753.371865:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348de680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17170:1874258609497472:0@lo:104: 00000100:00100000:2.0:1787432753.371921:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432753.371967:0:17170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948303850a00/0xca72b3b33563fe74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563fe6d expref: 21 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432753.371990:0:17170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948303850a00/0xca72b3b33563fe74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563fe6d expref: 21 pid: 17148 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432753.371999:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348ded80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17170:1874258609497600:0@lo:104: 00000100:00100000:2.0:1787432753.372022:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432753.372043:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484112cf840 going to sleep for 11 seconds 00000100:00100000:1.0:1787432753.372103:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787432753.372118:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609497472 00000100:00100000:1.0:1787432753.372124:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609497472 00000100:00100000:1.0:1787432753.372156:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609497600 00000100:00100000:1.0:1787432753.372158:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609497600 00000100:00100000:1.0:1787432753.372198:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787432753.372207:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+4:17170:x1874258609497472:12345-0@lo:104: 00010000:00010000:1.0:1787432753.372218:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563fe7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563fe82 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432753.372274:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787432753.372280:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+4:17170:x1874258609497472:12345-0@lo:104: Request processed in 75us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432753.372286:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787432753.372301:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787432753.372307:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435cd7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+3:17170:x1874258609497600:12345-0@lo:104: 00010000:00010000:1.0:1787432753.372314:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9484032e5800/0xca72b3b33563fe6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563fe74 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432753.372341:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787432753.372346:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435cd7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+3:17170:x1874258609497600:12345-0@lo:104: Request processed in 39us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432753.372351:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787432753.372394:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432753.372400:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563fe7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563fe82 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432753.372407:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e5000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432753.372411:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563fe7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563fe82 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432753.372420:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563fe7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563fe82 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432753.372427:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563fe7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563fe82 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432753.372433:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432753.372460:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563fe7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fe82 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432753.372466:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432753.372483:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563fe7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fe82 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432753.372490:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e5000/0xca72b3b33563fe7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fe82 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432753.372502:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432753.372506:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9484032e5800/0xca72b3b33563fe6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563fe74 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432753.372511:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e5800 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1787432753.372514:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9484032e5800/0xca72b3b33563fe6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563fe74 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432753.372526:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9484032e5800/0xca72b3b33563fe6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563fe74 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432753.372532:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9484032e5800/0xca72b3b33563fe6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563fe74 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432753.372537:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432753.372559:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9484032e5800/0xca72b3b33563fe6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fe74 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432753.372565:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432753.372579:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9484032e5800/0xca72b3b33563fe6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fe74 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432753.372586:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9484032e5800/0xca72b3b33563fe6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fe74 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432753.372598:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432753.372600:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432753.372601:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432753.372612:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3644:1874258609497728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432753.372638:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432753.372788:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3641:1874258609497856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432753.372812:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432753.372889:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348de680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17170:1874258609497472:0@lo:104: 00000100:00100000:2.0:1787432753.372897:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348ded80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17170:1874258609497600:0@lo:104: 00010000:00010000:2.0:1787432753.372918:0:17170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9484032e5400/0xca72b3b33563ff2a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432753.373208:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432753.373435:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:18654:x1874258609497344:12345-0@lo:253:mount.lustre.0 Request processed in 11960us (12918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432753.373445:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787432753.377253:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609497728 00000100:00100000:3.0:1787432753.377270:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609497728 00010000:00010000:3.0:1787432753.377311:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948303851200/0xca72b3b33563fe82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fe7b expref: 21 pid: 17147 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432753.377347:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609497856 00000100:00100000:3.0:1787432753.377350:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609497856 00010000:00010000:3.0:1787432753.377363:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948303850a00/0xca72b3b33563fe74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fe6d expref: 22 pid: 17148 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432753.377378:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787432753.377388:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304647b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:3644:x1874258609497728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432753.377403:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432753.377409:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948303851200/0xca72b3b33563fe82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fe7b expref: 22 pid: 17147 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432753.377421:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948303851200/0xca72b3b33563fe82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563fe7b expref: 22 pid: 17147 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432753.377439:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303851200/0xca72b3b33563fe82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563fe7b expref: 22 pid: 17147 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432753.377454:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432753.378317:0:17141:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787432753.378330:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787432753.378686:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304647b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:3644:x1874258609497728:12345-0@lo:103:ldlm_bl.0 Request processed in 1296us (6043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432753.378696:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787432753.378722:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787432753.378732:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:3641:x1874258609497856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432753.378757:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432753.378764:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948303850a00/0xca72b3b33563fe74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fe6d expref: 20 pid: 17148 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432753.378776:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948303850a00/0xca72b3b33563fe74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563fe6d expref: 20 pid: 17148 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432753.378790:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303850a00/0xca72b3b33563fe74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563fe6d expref: 20 pid: 17148 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432753.378803:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9484032e5400/0xca72b3b33563ff2a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432753.378811:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e5400/0xca72b3b33563ff2a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787432753.378825:0:17140:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007082102s 00010000:00010000:3.0:1787432753.378830:0:17140:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9484032e5400/0xca72b3b33563ff2a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432753.378837:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9484032e5400/0xca72b3b33563ff2a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432753.378843:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9484032e5400/0xca72b3b33563ff2a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432753.378850:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9484032e5400/0xca72b3b33563ff2a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432753.378856:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e5400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432753.378860:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9484032e5400/0xca72b3b33563ff2a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432753.378874:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9484032e5400/0xca72b3b33563ff2a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432753.378894:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9484032e5400/0xca72b3b33563ff2a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432753.378906:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432753.378956:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+19:3641:x1874258609497856:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (6142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432753.378962:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787432753.379129:0:17170:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9484032e5400/0xca72b3b33563ff2a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432753.379138:0:17170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9484032e5400/0xca72b3b33563ff2a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432753.379144:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e5400/0xca72b3b33563ff2a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432753.379232:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304647480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:18654:1874258609497344:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787432753.379253:0:18654:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787432753.379257:0:18654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787432753.379259:0:18654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787432753.379267:0:18654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432753.379269:0:18654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432753.379270:0:18654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432753.379272:0:18654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432753.379273:0:18654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787432753.379275:0:18654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432753.379277:0:18654:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787432753.379291:0:18654:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787432753.381766:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3644:1874258609497728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432753.383864:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3641:1874258609497856:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1787432753.388312:0:18654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787432753.393304:0:18654:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787432753.393314:0:18654:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787432753.393353:0:18654:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787432753.393398:0:18654:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.124@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787432753.393417:0:18654:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787432753.393614:0:18654:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1787432753.394572:0:18654:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787432753.394802:0:18654:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787432754.323048:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787432754.366443:0:18736:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432754.366716:0:18736:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1787432754.768026:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787432755.275351:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787432755.275360:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94843f837000 from 9 10000000:01000000:0.0:1787432755.275365:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787432755.275413:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304488400/0xca72b3b33563ff31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432755.275426:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948304488400/0xca72b3b33563ff31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432755.275436:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948304488400/0xca72b3b33563ff31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432755.275461:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609497984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787432755.275537:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432755.275586:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff948412a03a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432755.275656:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609497984 00000100:00100000:1.0:1787432755.275664:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609497984 00000100:00100000:1.0:1787432755.275734:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787432755.275743:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+19:17151:x1874258609497984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432755.275766:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432755.275780:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303850600/0xca72b3b33563ff38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ff31 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432755.275803:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303850600/0xca72b3b33563ff38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ff31 expref: 20 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432755.275813:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303850600/0xca72b3b33563ff38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ff31 expref: 20 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432755.275821:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850600, rc 0) 00000100:00100000:1.0:1787432755.275857:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:17151:x1874258609497984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432755.275864:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787432755.276492:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609497984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432755.276524:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948304488400/0xca72b3b33563ff31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ff38 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432755.276536:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948304488400/0xca72b3b33563ff31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ff38 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432755.276610:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609498112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787432755.276647:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432755.276679:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff948412a03a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432755.276932:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609498112 00000100:00100000:1.0:1787432755.276937:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609498112 00000100:00100000:1.0:1787432755.276983:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787432755.276991:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:17151:x1874258609498112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787432755.277007:0:17147:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787432755.277026:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787432755.277029:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1787432755.277131:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:17151:x1874258609498112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432755.277137:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787432755.277388:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609498112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787432755.277450:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787432755.277459:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304488400/0xca72b3b33563ff31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ff38 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432755.277468:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948304488400/0xca72b3b33563ff31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ff38 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432755.277477:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787432755.277480:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9483038e1000 from 9 10000000:01000000:0.0:1787432755.277482:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787432755.277505:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563ff3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432755.277522:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563ff3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432755.277531:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563ff3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432755.277546:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609498240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787432755.277576:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432755.277602:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff948412a03a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432755.277616:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609498240 00000100:00100000:0.0:1787432755.277627:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609498240 00000100:00100000:0.0:1787432755.277657:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787432755.277664:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:17151:x1874258609498240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432755.277673:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432755.277686:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948304488800/0xca72b3b33563ff46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33563ff3f expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432755.277705:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948304488800/0xca72b3b33563ff46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33563ff3f expref: 21 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432755.277714:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948304488800/0xca72b3b33563ff46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ff3f expref: 21 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432755.277723:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304488800, rc 0) 00000100:00100000:0.0:1787432755.277870:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:17151:x1874258609498240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432755.277877:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787432755.282726:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609498240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432755.283215:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563ff3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ff46 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432755.283230:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563ff3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33563ff46 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432755.283298:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609498368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787432755.283360:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432755.283404:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff948412a03a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432755.283821:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609498368 00000100:00100000:1.0:1787432755.283828:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609498368 00000100:00100000:1.0:1787432755.283880:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787432755.283897:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:17151:x1874258609498368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787432755.283916:0:17149:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787432755.283931:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787432755.283934:0:17149:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1787432755.284029:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:17151:x1874258609498368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432755.284037:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787432755.284131:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609498368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787432755.284428:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787432755.284438:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563ff3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ff46 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.284447:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563ff3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563ff46 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.341433:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432756.363958:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432757.387421:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432757.707516:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609498496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432757.707597:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432757.707831:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609498496 00000100:00100000:3.0:1787432757.707839:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609498496 00000100:00100000:3.0:1787432757.707896:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787432757.707908:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609498496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787432757.707941:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787432757.708000:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609498496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432757.708021:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787432757.708211:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609498496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432757.712639:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432757.712665:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609498624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432757.712739:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432757.712820:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609498624 00000100:00100000:3.0:1787432757.712829:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609498624 00000100:00100000:3.0:1787432757.712878:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787432757.712887:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609498624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787432757.712922:0:17160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787432757.712966:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609498624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432757.712973:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787432757.713020:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609498624:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787432758.411509:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787432758.731491:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432758.731499:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787432758.731502:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432758.731505:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787432758.731523:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432758.731526:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787432758.731529:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432758.731532:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787432758.731575:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609498880:0@lo:400:kworker.0 00000100:00100000:3.0:1787432758.731692:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432758.731745:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609499392:0@lo:400:kworker.0 00000100:00100000:3.0:1787432758.731779:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432758.731809:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787432758.731815:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609499008:0@lo:400:kworker.0 00000100:00100000:3.0:1787432758.731839:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432758.731859:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609499520:0@lo:400:kworker.0 00000100:00100000:3.0:1787432758.731883:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432758.731926:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609498880 00000100:00100000:3.0:1787432758.731934:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609498880 00000100:00100000:3.0:1787432758.731980:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787432758.731990:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609498880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432758.732050:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609498880:12345-0@lo:400:kworker.0 Request processed in 61us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432758.732057:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787432758.732086:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609499392 00000100:00100000:3.0:1787432758.732090:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609499392 00000100:00100000:3.0:1787432758.732120:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609499008 00000100:00100000:3.0:1787432758.732123:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609499008 00000100:00100000:3.0:1787432758.732134:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609499520 00000100:00100000:3.0:1787432758.732137:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609499520 00000100:00100000:3.0:1787432758.732154:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787432758.732161:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609499392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432758.732215:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609499392:12345-0@lo:400:kworker.0 Request processed in 55us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432758.732222:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787432758.732235:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787432758.732251:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609499008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432758.732280:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609499008:12345-0@lo:400:kworker.0 Request processed in 31us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432758.732286:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787432758.732299:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787432758.732308:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609499520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432758.732335:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609499520:12345-0@lo:400:kworker.0 Request processed in 30us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432758.732342:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787432758.732390:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbc380 x1874258609499008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432758.732405:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609499008:0@lo:400:kworker.0 00010000:00080000:3.0:1787432758.732417:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbf800 x1874258609499520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432758.732425:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609499520:0@lo:400:kworker.0 00000100:00100000:3.0:1787432758.732436:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609498880:0@lo:400:kworker.0 00010000:00080000:3.0:1787432758.732455:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbce00 x1874258609499392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432758.732463:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609499392:0@lo:400:kworker.0 00000100:00100000:2.0:1787432758.733088:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609499136:0@lo:400:kworker.0 00000100:00100000:2.0:1787432758.733135:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432758.733188:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787432758.733195:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609498752:0@lo:400:kworker.0 00000100:00100000:2.0:1787432758.733223:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432758.733251:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609499264:0@lo:400:kworker.0 00000100:00100000:2.0:1787432758.733279:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432758.733361:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609499136 00000100:00100000:3.0:1787432758.733366:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609499136 00000100:00100000:3.0:1787432758.733409:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787432758.733418:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609499136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432758.733481:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609499136:12345-0@lo:400:kworker.0 Request processed in 64us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432758.733487:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787432758.733508:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609499264 00000100:00100000:3.0:1787432758.733512:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609499264 00000100:00100000:3.0:1787432758.733541:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787432758.733548:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609499264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432758.733579:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609499264:12345-0@lo:400:kworker.0 Request processed in 32us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432758.733586:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787432758.733672:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbd500 x1874258609499264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432758.733683:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609499264:0@lo:400:kworker.0 00000100:00100000:2.0:1787432758.733694:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609499136:0@lo:400:kworker.0 00000100:00080000:1.0:1787432758.733802:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432758.733808:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432758.733820:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609498752 00000100:00100000:1.0:1787432758.733824:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609498752 00000100:00100000:1.0:1787432758.733863:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787432758.733871:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:3643:x1874258609498752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432758.733909:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:3643:x1874258609498752:12345-0@lo:400:kworker.0 Request processed in 40us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432758.733916:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787432758.733998:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609498752:0@lo:400:kworker.0 00010000:00010000:1.0:1787432759.437602:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787432759.888349:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1787432760.454539:0:19025:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787432760.463557:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432761.486040:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787432761.546927:0:19078:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787432761.550515:0:19078:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787432762.507378:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432762.572214:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432747/real 1787432747] req@ffff948303799180 x1874258609492992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432762 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432762.572246:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948303799180 x1874258609492992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432762 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432762.572257:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432747/real 1787432747] req@ffff948303799880 x1874258609493120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432762 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432762.572270:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948303799880 x1874258609493120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432762 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787432762.572301:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948434887000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432762.572330:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787432762.572335:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609492992:0@lo:8:kworker.0 00000100:00080000:1.0:1787432762.572341:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432762.572347:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787432762.572350:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609493120:0@lo:8:kworker.0 00000100:00080000:0.0:1787432762.572526:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432762.572531:0:474:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432762.572534:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432762.572537:0:474:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432762.572570:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432762.572574:0:474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787432762.572577:0:474:0:(import.c:65:import_set_state_nolock()) ffff948434887000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432762.572582:0:474:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 558 00000100:00080000:0.0:1787432762.572588:0:474:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787432762.572594:0:474:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff948434887000 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432762.572629:0:474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9484359e8380 x1874258609500160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432762.572641:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432762.572644:0:474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787432762.572646:0:474:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432762.572649:0:474:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 558 00000100:00080000:0.0:1787432762.572652:0:474:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787432762.572655:0:474:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94843c7f3800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432762.572665:0:474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9484359ebb80 x1874258609500288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787432762.572706:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609499904:0@lo:400:kworker.0 00000100:00100000:0.0:1787432762.572794:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432762.572855:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609500672:0@lo:400:kworker.0 00000100:00100000:0.0:1787432762.572878:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432762.572901:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432762.572907:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609500032:0@lo:400:kworker.0 00000100:00100000:0.0:1787432762.572931:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432762.572966:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609499904 00000100:00100000:0.0:1787432762.572974:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609499904 00000100:00100000:0.0:1787432762.573022:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609500672 00000100:00100000:0.0:1787432762.573026:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609500672 00000100:00100000:0.0:1787432762.573054:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787432762.573078:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609499904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432762.573126:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609499904:12345-0@lo:400:kworker.0 Request processed in 51us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432762.573133:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787432762.573152:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787432762.573158:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609500672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432762.573213:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609500672:12345-0@lo:400:kworker.0 Request processed in 55us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432762.573219:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787432762.573240:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609500032 00000100:00100000:0.0:1787432762.573244:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609500032 00000100:00100000:0.0:1787432762.573269:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787432762.573275:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609500032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432762.573306:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609500032:12345-0@lo:400:kworker.0 Request processed in 31us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432762.573312:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787432762.573358:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609500032:0@lo:400:kworker.0 00010000:00080000:0.0:1787432762.573379:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9484359ea680 x1874258609499904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432762.573388:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609499904:0@lo:400:kworker.0 00010000:00080000:0.0:1787432762.573397:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9484359eaa00 x1874258609500672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432762.573406:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609500672:0@lo:400:kworker.0 00000100:00100000:3.0:1787432762.573764:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609499648:0@lo:400:kworker.0 00000100:00100000:3.0:1787432762.573811:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432762.573839:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609500416:0@lo:400:kworker.0 00000100:00100000:3.0:1787432762.573862:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432762.573880:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787432762.573886:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609499776:0@lo:400:kworker.0 00000100:00100000:3.0:1787432762.573908:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432762.573926:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609500544:0@lo:400:kworker.0 00000100:00100000:3.0:1787432762.573944:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432762.573966:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609499776 00000100:00100000:3.0:1787432762.573969:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609499776 00000100:00100000:3.0:1787432762.573995:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787432762.574002:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609499776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432762.574038:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609499776:12345-0@lo:400:kworker.0 Request processed in 37us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432762.574053:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787432762.574096:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609499776:0@lo:400:kworker.0 00000100:00100000:1.0:1787432762.574277:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609500160:0@lo:8:kworker.0 00000100:00100000:1.0:1787432762.574315:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432762.574343:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609500288:0@lo:8:kworker.0 00000100:00100000:1.0:1787432762.574365:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787432762.574410:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787432762.574494:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609500160 00000100:00100000:2.0:1787432762.574499:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609500160 00000100:00100000:2.0:1787432762.574516:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609500288 00000100:00100000:2.0:1787432762.574518:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609500288 00000100:00100000:2.0:1787432762.574528:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787432762.574540:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1874258609500160:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787432762.574565:0:18660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:2.0:1787432762.574592:0:18660:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b33563ff4d 00002000:00100000:2.0:1787432762.575788:0:18660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9483039e6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1787432762.575798:0:18660:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1787432762.575801:0:18660:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1787432762.579624:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609500416 00000100:00100000:0.0:1787432762.579645:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609500416 00000100:00100000:0.0:1787432762.579721:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609500544 00000100:00100000:0.0:1787432762.579741:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609500544 00000100:00100000:0.0:1787432762.579786:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787432762.579798:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609500416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432762.579920:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609500416:12345-0@lo:400:kworker.0 Request processed in 125us (6057us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432762.579928:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787432762.579948:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787432762.579955:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609500544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432762.579986:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609500544:12345-0@lo:400:kworker.0 Request processed in 31us (6041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432762.579992:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787432762.580053:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9484359e8a80 x1874258609500544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432762.580410:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609500544:0@lo:400:kworker.0 00010000:00080000:0.0:1787432762.580450:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9484359e8000 x1874258609500416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432762.580459:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609500416:0@lo:400:kworker.0 00000100:00100000:1.0:1787432762.581090:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609499648 00000100:00100000:1.0:1787432762.581102:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609499648 00000100:00100000:1.0:1787432762.581188:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787432762.581198:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:3643:x1874258609499648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432762.581275:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:3643:x1874258609499648:12345-0@lo:400:kworker.0 Request processed in 79us (7464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432762.581283:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1787432762.581327:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432762.581352:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609499648:0@lo:400:kworker.0 00002000:00080000:2.0:1787432762.581810:0:18660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1787432762.581840:0:18660:0:(import.c:65:import_set_state_nolock()) ffff9483039e3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432762.581898:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1874258609500160:12345-0@lo:8:kworker.0 Request processed in 7357us (7581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432762.581906:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787432762.581924:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432762.581929:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1874258609500288:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787432762.581946:0:18660:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1787432762.583658:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9484359e8380 x1874258609500160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787432782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432762.583674:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787432762.583683:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787432762.583710:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787432762.583716:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787432762.583720:0:3640:0:(import.c:65:import_set_state_nolock()) ffff948434887000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787432762.583763:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787432762.583770:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609500160:0@lo:8:kworker.0 00000004:00080000:1.0:1787432762.583806:0:17895:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787432762.583906:0:17895:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 573675741131ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787432762.583913:0:17895:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1787432762.584489:0:17896:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787432762.584514:0:17896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17896:1874258609500928:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1787432762.584572:0:17896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432762.584603:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff948412a03cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432762.584627:0:18659:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787432762.584634:0:18659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787432762.584647:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432762.584658:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609500800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432762.584684:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432762.589095:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609500928 00000100:00100000:1.0:1787432762.589112:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609500928 00000100:00080000:1.0:1787432762.589202:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432762.589285:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432762.589295:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17896:x1874258609500928:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:1.0:1787432762.596973:0:19127:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1787432762.596986:0:19127:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787432762.598342:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17896:x1874258609500928:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9036us (13757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432762.598358:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787432762.598437:0:17896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948303a3bb80 x1874258609500928/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787432778 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432762.598453:0:17896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17896:1874258609500928:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787432762.598468:0:17896:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787432762.598514:0:17896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17896:1874258609501056:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1787432762.598562:0:17896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432762.598586:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff948303791cc0 going to sleep for 11 seconds 00000004:00080000:3.0:1787432762.600052:0:17886:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787432762.601048:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609501056 00000100:00100000:1.0:1787432762.601154:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609501056 00000100:00100000:1.0:1787432762.601247:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787432762.601258:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17896:x1874258609501056:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787432762.601294:0:18659:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1787432762.601388:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17896:x1874258609501056:12345-0@lo:5:osp-pre-0-1.0 Request processed in 133us (2826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432762.601395:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787432762.601440:0:17896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948304645880 x1874258609501056/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787432778 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432762.601455:0:17896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17896:1874258609501056:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1787432762.601467:0:17896:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787432762.603767:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609500800 00000100:00100000:0.0:1787432762.603784:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609500800 00000100:00100000:0.0:1787432762.603848:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432762.603860:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1874258609500800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787432762.603891:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787432762.603979:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1874258609500800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (19294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432762.603987:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787432762.604291:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948303a3ad80 x1874258609500800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432762.604314:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609500800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432762.630615:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1874258609500288:12345-0@lo:8:kworker.0 Request processed in 48662us (56227us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787432762.630631:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787432762.640323:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432762.640337:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787432762.640344:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609500288:0@lo:8:kworker.0 00000020:00000004:0.0:1787432762.654627:0:19129:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787432762.658604:0:19129:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787432762.838506:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609501184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787432762.838582:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432762.838649:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609501184 00000100:00100000:2.0:1787432762.838656:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609501184 00000100:00100000:2.0:1787432762.838714:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787432762.838737:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609501184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787432762.838773:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787432762.838817:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609501184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432762.838824:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787432762.838872:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609501184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432762.839113:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432762.839122:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609501312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432762.840262:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432762.840462:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609501312 00000100:00100000:0.0:1787432762.840472:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609501312 00000100:00100000:0.0:1787432762.840521:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787432762.840531:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609501312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432762.840587:0:17160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787432762.840646:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609501312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432762.840652:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787432762.840802:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609501312:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787432763.532134:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432764.556497:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787432765.010506:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787432765.580284:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432766.605662:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432766.667321:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432746/real 1787432746] req@ffff948303798380 x1874258609491200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432766 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432766.667366:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff948303798380 x1874258609491200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432766 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432766.667377:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432746/real 1787432746] req@ffff94830379a300 x1874258609491328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432766 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432766.671000:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94830379a300 x1874258609491328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432766 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787432766.671026:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484166d0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432766.671044:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787432766.671048:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609491200:0@lo:8:kworker.0 00000100:00080000:1.0:1787432766.671054:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484034a6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432766.671059:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787432766.671062:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609491328:0@lo:8:kworker.0 00000100:00080000:0.0:1787432766.671596:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432766.671601:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787432766.671604:0:8:0:(import.c:65:import_set_state_nolock()) ffff9484166d0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432766.671610:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 557 00000100:00080000:0.0:1787432766.671614:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787432766.671632:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9484166d0800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432766.671655:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948303a3b100 x1874258609501696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432766.671683:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432766.671686:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787432766.671689:0:8:0:(import.c:65:import_set_state_nolock()) ffff9484034a6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432766.671692:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 557 00000100:00080000:0.0:1787432766.671694:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787432766.671698:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9484034a6800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432766.671711:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948303a3aa00 x1874258609501824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432766.671753:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432766.671757:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787432766.671759:0:8:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432766.671762:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 573 00000100:00080000:0.0:1787432766.671779:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787432766.671783:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94843c7f3800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432766.671796:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948303a3a680 x1874258609502336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787432766.671840:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609501952:0@lo:400:kworker.0 00000100:00100000:0.0:1787432766.671904:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432766.671964:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609502592:0@lo:400:kworker.0 00000100:00100000:0.0:1787432766.671988:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432766.672016:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787432766.672021:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609502080:0@lo:400:kworker.0 00000100:00100000:0.0:1787432766.672047:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432766.672067:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609502720:0@lo:400:kworker.0 00000100:00100000:0.0:1787432766.672089:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432766.672122:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609501952 00000100:00100000:0.0:1787432766.672130:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609501952 00000100:00100000:0.0:1787432766.672207:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609502592 00000100:00100000:0.0:1787432766.672211:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609502592 00000100:00100000:0.0:1787432766.672234:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609502720 00000100:00100000:0.0:1787432766.672251:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609502720 00000100:00100000:0.0:1787432766.672270:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787432766.672279:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609501952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432766.672340:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609501952:12345-0@lo:400:kworker.0 Request processed in 62us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432766.672348:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787432766.672366:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787432766.672374:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609502592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432766.672430:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609502592:12345-0@lo:400:kworker.0 Request processed in 57us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432766.672437:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787432766.672452:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787432766.672460:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609502720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432766.672490:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609502720:12345-0@lo:400:kworker.0 Request processed in 31us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432766.672496:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787432766.672519:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609502080 00000100:00100000:0.0:1787432766.672523:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609502080 00000100:00100000:0.0:1787432766.672551:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787432766.672558:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609502080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432766.672591:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609502080:12345-0@lo:400:kworker.0 Request processed in 34us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432766.672597:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787432766.672661:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609502080:0@lo:400:kworker.0 00010000:00080000:0.0:1787432766.672675:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948303a38a80 x1874258609502720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432766.672685:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609502720:0@lo:400:kworker.0 00010000:00080000:0.0:1787432766.672695:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948303a3b480 x1874258609501952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432766.672702:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609501952:0@lo:400:kworker.0 00010000:00080000:0.0:1787432766.672712:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948303a39c00 x1874258609502592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432766.672733:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609502592:0@lo:400:kworker.0 00000100:00100000:3.0:1787432766.672841:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609501696:0@lo:8:kworker.0 00000100:00100000:3.0:1787432766.672875:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432766.672911:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609501824:0@lo:8:kworker.0 00000100:00100000:3.0:1787432766.672933:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432766.672950:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609502336:0@lo:8:kworker.0 00000100:00100000:3.0:1787432766.672971:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432766.673008:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609501696 00000100:00100000:3.0:1787432766.673012:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609501696 00000100:00100000:3.0:1787432766.673028:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609501824 00000100:00100000:3.0:1787432766.673030:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609501824 00000100:00100000:3.0:1787432766.673038:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609502336 00000100:00100000:3.0:1787432766.673040:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609502336 00000100:00100000:3.0:1787432766.673049:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787432766.673054:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1874258609501696:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787432766.673080:0:18661:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:3.0:1787432766.673109:0:18661:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b33563ff54 00002000:00100000:3.0:1787432766.673123:0:18661:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff948301e05000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787432766.673134:0:18661:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787432766.673137:0:18661:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787432766.673237:0:18661:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787432766.673259:0:18661:0:(import.c:65:import_set_state_nolock()) ffff948301e02800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432766.673313:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1874258609501696:12345-0@lo:8:kworker.0 Request processed in 258us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432766.673320:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787432766.673335:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787432766.673340:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1874258609501824:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787432766.673351:0:18661:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787432766.673379:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1874258609501824:12345-0@lo:8:kworker.0 Request processed in 38us (445us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787432766.673385:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787432766.673398:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787432766.673403:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1874258609502336:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787432766.673413:0:18661:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787432766.673438:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1874258609502336:12345-0@lo:8:kworker.0 Request processed in 34us (466us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787432766.673444:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787432766.673473:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948303a3b100 x1874258609501696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787432791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432766.673482:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787432766.673489:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787432766.673497:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787432766.673502:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787432766.673511:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484166d0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787432766.673524:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787432766.673529:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609501696:0@lo:8:kworker.0 00000100:00080000:3.0:1787432766.673542:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484034a6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787432766.673546:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787432766.673549:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609501824:0@lo:8:kworker.0 00000100:00080000:3.0:1787432766.673558:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787432766.673561:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787432766.673564:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609502336:0@lo:8:kworker.0 00000004:00080000:3.0:1787432766.673606:0:17179:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1787432766.673622:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17179:1874258609502976:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787432766.673646:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432766.673662:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830316b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787432766.673674:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609502976 00000100:00100000:3.0:1787432766.673677:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609502976 00000100:00100000:3.0:1787432766.673700:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432766.673707:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17179:x1874258609502976:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787432766.674897:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3641:1874258609501440:0@lo:400:kworker.0 00000100:00100000:1.0:1787432766.674948:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432766.674989:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609502208:0@lo:400:kworker.0 00000100:00100000:1.0:1787432766.675012:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432766.675024:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609502848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432766.675044:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432766.675066:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787432766.675073:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609501568:0@lo:400:kworker.0 00000100:00100000:1.0:1787432766.675099:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432766.675120:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609502464:0@lo:400:kworker.0 00000100:00100000:1.0:1787432766.675144:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432766.675208:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609502464 00000100:00100000:1.0:1787432766.675214:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609502464 00000100:00100000:1.0:1787432766.675264:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787432766.675272:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609502464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432766.675338:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609502464:12345-0@lo:400:kworker.0 Request processed in 66us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432766.675346:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787432766.675642:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609502208 00000100:00100000:2.0:1787432766.675647:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609502208 00000100:00100000:2.0:1787432766.675675:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787432766.675681:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1874258609502208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432766.675716:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1874258609502208:12345-0@lo:400:kworker.0 Request processed in 35us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432766.675722:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787432766.676553:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787432766.676560:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432766.676562:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1787432766.676578:0:17178:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787432766.676843:0:17178:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 577768677860ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787432766.676851:0:17178:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1787432766.676882:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609501440 00000100:00100000:1.0:1787432766.676888:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609501440 00000100:00100000:1.0:1787432766.676920:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787432766.676928:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:3641:x1874258609501440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432766.676978:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:3641:x1874258609501440:12345-0@lo:400:kworker.0 Request processed in 50us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432766.676984:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787432766.677015:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609501568 00000100:00100000:1.0:1787432766.677019:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609501568 00000100:00100000:1.0:1787432766.677046:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787432766.677053:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609501568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432766.677086:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609501568:12345-0@lo:400:kworker.0 Request processed in 33us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432766.677092:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787432766.677153:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609501568:0@lo:400:kworker.0 00010000:00080000:1.0:1787432766.677191:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948303a38700 x1874258609502464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432766.677201:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609502464:0@lo:400:kworker.0 00000100:00100000:1.0:1787432766.677223:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3641:1874258609501440:0@lo:400:kworker.0 00010000:00080000:1.0:1787432766.677233:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948303a38e00 x1874258609502208/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1787432766.680391:0:18661:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00000100:00100000:0.0:1787432766.680691:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609502848 00000100:00100000:0.0:1787432766.680701:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609502848 00000100:00100000:0.0:1787432766.680760:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432766.680770:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874258609502848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432766.680800:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787432766.680871:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874258609502848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (5825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432766.680878:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00080000:3.0:1787432766.680935:0:18661:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787432766.680941:0:18661:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000100:00100000:1.0:1787432766.681066:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609502208:0@lo:400:kworker.0 00010000:00080000:1.0:1787432766.681091:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948301dbdc00 x1874258609502848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432766.681105:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609502848:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1787432766.685575:0:17134:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787432766.694695:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.694708:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ff5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.694724:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.694729:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.694743:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ff5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.694761:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ff5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.694772:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ff5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.694779:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ff5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.694873:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787432766.695452:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.695459:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ff62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.695469:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.695472:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.695476:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ff62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.695485:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ff62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.695493:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ff62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.695511:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ff62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.696136:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432766.696145:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ff5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.696154:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432766.696159:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ff5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.696193:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ff5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.696214:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ff5b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.696221:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ff5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.696254:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432766.696258:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ff62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.696264:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0c00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432766.696267:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ff62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.696274:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ff62 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.696295:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ff62 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.696303:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.696305:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.696307:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432766.696725:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787432766.696732:0:18661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ff62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432766.698244:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.698254:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ff69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.698269:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.698274:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.698280:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ff69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.698302:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ff69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.698312:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ff69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.698319:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ff69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.698702:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432766.698710:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ff69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.698719:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432766.698723:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ff69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.698733:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ff69 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.698753:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ff69 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.698769:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432766.698770:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432766.698772:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432766.699230:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787432766.699238:0:18661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ff69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.699607:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432766.699703:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.699710:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ff70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.699721:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.699725:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.699731:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ff70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.699742:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ff70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.699750:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ff70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.699757:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ff70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.699824:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787432766.701387:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.701398:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.701421:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.701425:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.701432:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.701445:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.701455:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.701462:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.704555:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787432766.704571:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ff70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.704705:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432766.704713:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ff70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.704725:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ff70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.704865:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ff70 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.704875:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ff70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.704910:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432766.704914:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.704921:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0a00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432766.704937:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.704946:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff77 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.704956:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff77 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.704964:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432766.704966:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432766.704968:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432766.709738:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787432766.709751:0:18661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.714262:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787432766.723043:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787432766.723060:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b98c871c/0xca72b3b33563ff7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.723079:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=577s v=(0 0) 00010000:00010000:0.0:1787432766.723084:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432766.723090:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b98c871c/0xca72b3b33563ff7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.723105:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b98c871c/0xca72b3b33563ff7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.723115:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b98c871c/0xca72b3b33563ff7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.723122:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b98c871c/0xca72b3b33563ff7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.723383:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787432766.724280:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787432766.724299:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33563ff85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.724311:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=577s v=(0 0) 00010000:00010000:0.0:1787432766.724315:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432766.724320:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33563ff85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.724331:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33563ff85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.724340:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33563ff85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.724348:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33563ff85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.726151:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787432766.726178:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b98c871c/0xca72b3b33563ff7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.726192:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489a00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432766.726197:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b98c871c/0xca72b3b33563ff7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.726208:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b98c871c/0xca72b3b33563ff7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.726230:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b98c871c/0xca72b3b33563ff7e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.726238:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b98c871c/0xca72b3b33563ff7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.726280:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432766.726646:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33563ff85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.726654:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488e00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432766.726658:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33563ff85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.726667:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33563ff85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.726679:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33563ff85 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.726688:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432766.726690:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432766.726692:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432766.730894:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787432766.730910:0:18661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33563ff85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.730988:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787432766.732278:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787432766.732493:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b33563ff8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.732519:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=577s v=(0 0) 00010000:00010000:0.0:1787432766.732524:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432766.732531:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b33563ff8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.732546:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b33563ff8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.732556:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b33563ff8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.732563:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b33563ff8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.732589:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432766.732761:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432766.732769:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b33563ff8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.732779:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432766.732784:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b33563ff8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.732806:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b33563ff8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.732825:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b33563ff8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.732831:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b33563ff8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.732852:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432766.732854:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432766.732856:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787432766.734559:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787432766.734573:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b33563ff93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.734590:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=577s v=(0 0) 00010000:00010000:0.0:1787432766.734595:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432766.734602:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b33563ff93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.734615:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b33563ff93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.734642:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b33563ff93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.734650:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b33563ff93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.734671:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432766.737964:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432766.737981:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b33563ff93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.737996:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432766.738002:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b33563ff93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.738015:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b33563ff93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.738038:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b33563ff93 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.738059:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b33563ff93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.738087:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432766.738089:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432766.738091:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432766.741964:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.742092:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.742112:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.742118:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.742124:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.742184:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.742196:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.742204:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.742224:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432766.742319:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432766.742325:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.742334:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0a00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432766.742339:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.742348:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.742366:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.742374:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ff9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.742403:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432766.742406:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432766.742408:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432766.743690:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.743701:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffa1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.743715:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.743719:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.743725:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.743737:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.743747:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.743755:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.743770:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432766.743836:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432766.743844:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.743852:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432766.743926:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.743953:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.743970:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffa1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.743978:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffa1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.744456:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.744457:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.744460:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432766.745938:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.745949:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ffa8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.745978:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.745992:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.745998:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ffa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.746012:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ffa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.746021:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ffa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.746027:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ffa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.746054:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432766.746367:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432766.746375:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ffa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.746385:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0c00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432766.746389:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ffa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.746399:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ffa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.746415:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ffa8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.746434:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef755bd3/0xca72b3b33563ffa8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.746457:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.746459:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.746462:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432766.746896:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.746903:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081e8702b/0xca72b3b33563ffaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.746914:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.746917:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.746921:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081e8702b/0xca72b3b33563ffaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.746932:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081e8702b/0xca72b3b33563ffaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.746952:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081e8702b/0xca72b3b33563ffaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.746959:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081e8702b/0xca72b3b33563ffaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.747059:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787432766.747529:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.747536:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b09f3592/0xca72b3b33563ffb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.747545:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.747548:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.747553:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b09f3592/0xca72b3b33563ffb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.747562:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b09f3592/0xca72b3b33563ffb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.747570:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b09f3592/0xca72b3b33563ffb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.747577:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b09f3592/0xca72b3b33563ffb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.748646:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432766.748657:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081e8702b/0xca72b3b33563ffaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.748667:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0e00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432766.748671:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081e8702b/0xca72b3b33563ffaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.748680:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081e8702b/0xca72b3b33563ffaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.748697:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081e8702b/0xca72b3b33563ffaf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.748706:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081e8702b/0xca72b3b33563ffaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.748731:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432766.748735:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b09f3592/0xca72b3b33563ffb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.748753:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0800 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432766.748758:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b09f3592/0xca72b3b33563ffb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.748766:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b09f3592/0xca72b3b33563ffb6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.748778:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b09f3592/0xca72b3b33563ffb6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.748785:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.748787:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.748788:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432766.751212:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787432766.751227:0:18661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b09f3592/0xca72b3b33563ffb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432766.752224:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.752245:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ffbd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.752260:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.752265:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.752271:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ffbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.752294:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ffbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.752304:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ffbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.752312:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ffbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.754659:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432766.754674:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ffbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.754687:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0a00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432766.754692:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ffbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.754703:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ffbd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.754723:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ffbd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.754752:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.754754:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.754758:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.755534:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432766.755566:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787432766.755577:0:18661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e8ca33a/0xca72b3b33563ffbd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432766.757502:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.757517:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.757533:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.757538:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.757544:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.757559:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.757568:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.757575:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.757603:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432766.758342:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432766.758351:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.758362:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432766.758367:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.758377:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.758398:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffc4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.758405:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3609b3e/0xca72b3b33563ffc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.758429:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.758431:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.758434:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432766.759385:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.759396:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ffcb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.759411:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.759416:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.759435:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ffcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.759448:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ffcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.759456:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ffcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.759464:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ffcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.759495:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432766.760125:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432766.760135:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ffcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.760156:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432766.760160:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ffcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.760220:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ffcb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.760447:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ffcb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.760456:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a45ba08/0xca72b3b33563ffcb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.760482:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.760485:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.760487:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432766.761587:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.761597:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ffd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.761612:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.761616:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.761622:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ffd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.761634:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ffd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.761643:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ffd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.761668:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ffd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.761694:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432766.762604:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432766.762614:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ffd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.762625:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432766.762630:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ffd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.762639:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ffd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.762670:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ffd2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.762678:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b6056d7/0xca72b3b33563ffd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.762702:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.762704:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.762707:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432766.763975:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.764058:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017ba8f21/0xca72b3b33563ffd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.764074:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.764079:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.764086:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017ba8f21/0xca72b3b33563ffd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.764100:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017ba8f21/0xca72b3b33563ffd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.764110:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017ba8f21/0xca72b3b33563ffd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.764118:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017ba8f21/0xca72b3b33563ffd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.764145:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432766.764704:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432766.764712:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017ba8f21/0xca72b3b33563ffd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.764721:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ec00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432766.764726:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017ba8f21/0xca72b3b33563ffd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.764735:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017ba8f21/0xca72b3b33563ffd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.764753:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017ba8f21/0xca72b3b33563ffd9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.764760:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017ba8f21/0xca72b3b33563ffd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.764805:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.764808:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.764810:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432766.766203:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.766216:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daacad1f/0xca72b3b33563ffe0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.766689:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.766695:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.766702:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daacad1f/0xca72b3b33563ffe0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.766717:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daacad1f/0xca72b3b33563ffe0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.766727:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daacad1f/0xca72b3b33563ffe0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.766735:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000daacad1f/0xca72b3b33563ffe0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.766763:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432766.767456:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432766.767464:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000daacad1f/0xca72b3b33563ffe0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.767474:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85f000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432766.767479:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000daacad1f/0xca72b3b33563ffe0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.767488:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000daacad1f/0xca72b3b33563ffe0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.767507:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000daacad1f/0xca72b3b33563ffe0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.767515:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daacad1f/0xca72b3b33563ffe0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.767535:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.767537:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.767540:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432766.768726:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.768736:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd861195/0xca72b3b33563ffe7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.768749:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.768753:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.768760:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd861195/0xca72b3b33563ffe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.768772:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd861195/0xca72b3b33563ffe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.768811:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd861195/0xca72b3b33563ffe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.768818:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd861195/0xca72b3b33563ffe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.768841:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432766.770082:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432766.770093:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd861195/0xca72b3b33563ffe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.770118:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85f400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432766.770123:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd861195/0xca72b3b33563ffe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.770132:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd861195/0xca72b3b33563ffe7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.770149:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd861195/0xca72b3b33563ffe7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.770155:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd861195/0xca72b3b33563ffe7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.770195:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.770197:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.770198:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432766.772838:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.772854:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001965f285/0xca72b3b33563ffee lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.773448:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.773452:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.773458:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001965f285/0xca72b3b33563ffee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.773472:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001965f285/0xca72b3b33563ffee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.773482:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001965f285/0xca72b3b33563ffee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.773490:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001965f285/0xca72b3b33563ffee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.773534:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432766.774544:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432766.774554:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001965f285/0xca72b3b33563ffee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.774564:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85f600 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432766.774569:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001965f285/0xca72b3b33563ffee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.774579:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001965f285/0xca72b3b33563ffee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.774597:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001965f285/0xca72b3b33563ffee lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.774604:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001965f285/0xca72b3b33563ffee lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.774623:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432766.774625:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432766.774626:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432766.775665:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.775676:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3595aa2/0xca72b3b33563fff5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.775690:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.775694:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.775700:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3595aa2/0xca72b3b33563fff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.775712:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3595aa2/0xca72b3b33563fff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.775722:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3595aa2/0xca72b3b33563fff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.775729:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3595aa2/0xca72b3b33563fff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.775752:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432766.777003:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432766.777016:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3595aa2/0xca72b3b33563fff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.777028:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432766.777032:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3595aa2/0xca72b3b33563fff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.777043:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3595aa2/0xca72b3b33563fff5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.777065:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3595aa2/0xca72b3b33563fff5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.777073:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3595aa2/0xca72b3b33563fff5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.777099:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432766.777101:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432766.777102:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787432766.786692:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787432766.786707:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbfe0cf0/0xca72b3b33563fffc lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.786726:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=577s v=(0 0) 00010000:00010000:2.0:1787432766.786732:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432766.786738:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbfe0cf0/0xca72b3b33563fffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.786767:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbfe0cf0/0xca72b3b33563fffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.786779:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbfe0cf0/0xca72b3b33563fffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.786800:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbfe0cf0/0xca72b3b33563fffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.786883:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787432766.792362:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432766.792376:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059fe94dc/0xca72b3b335640003 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.792393:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=577s v=(0 0) 00010000:00010000:3.0:1787432766.792405:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432766.792411:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059fe94dc/0xca72b3b335640003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.792425:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059fe94dc/0xca72b3b335640003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.792435:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059fe94dc/0xca72b3b335640003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.792443:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059fe94dc/0xca72b3b335640003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.793456:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432766.793468:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbfe0cf0/0xca72b3b33563fffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.793479:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e4600 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432766.793484:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbfe0cf0/0xca72b3b33563fffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.793493:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbfe0cf0/0xca72b3b33563fffc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.793522:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbfe0cf0/0xca72b3b33563fffc lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.793529:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbfe0cf0/0xca72b3b33563fffc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.793550:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432766.793554:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059fe94dc/0xca72b3b335640003 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.793561:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85f800 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432766.793564:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059fe94dc/0xca72b3b335640003 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.793571:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059fe94dc/0xca72b3b335640003 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.793580:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059fe94dc/0xca72b3b335640003 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432766.793588:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.793590:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432766.793591:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432766.796334:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787432766.796350:0:18661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059fe94dc/0xca72b3b335640003 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432766.796536:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787432766.803213:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787432766.803231:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33564000a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.803947:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=577s v=(0 0) 00010000:00010000:0.0:1787432766.803952:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432766.803959:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33564000a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.803973:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33564000a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.804042:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33564000a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.804051:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33564000a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.805696:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787432766.807222:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787432766.807248:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b335640011 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.807265:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=577s v=(0 0) 00010000:00010000:0.0:1787432766.807269:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432766.807276:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b335640011 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.807299:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b335640011 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.807309:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b335640011 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.807318:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b335640011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.810294:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787432766.810309:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33564000a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.810322:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488e00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432766.810327:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33564000a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.810338:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33564000a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.810603:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33564000a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.810611:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d96eb98/0xca72b3b33564000a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.812397:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787432766.812425:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432766.812433:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b335640011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.812445:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432766.812459:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b335640011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.812470:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b335640011 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.812490:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b335640011 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.812497:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bdaf166/0xca72b3b335640011 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.812520:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432766.812522:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432766.812524:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787432766.813654:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787432766.813665:0:18661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b335640018 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.813679:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=577s v=(0 0) 00010000:00010000:0.0:1787432766.813683:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432766.813690:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b335640018 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.813703:0:18661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b335640018 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.813714:0:18661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b335640018 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.813733:0:18661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b335640018 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.813751:0:18661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787432766.813763:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432766.813769:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b335640018 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.813777:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432766.813781:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b335640018 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432766.813965:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432766.814061:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b335640018 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.814077:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b335640018 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.814085:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000560166c1/0xca72b3b335640018 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432766.814105:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432766.814107:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432766.814109:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787432766.814333:0:18661:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:0.0:1787432766.814662:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17179:x1874258609502976:12345-0@lo:5:osp-pre-0-0.0 Request processed in 140951us (141010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432766.814682:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432766.815764:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17179:1874258609502976:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787432766.815781:0:17179:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1787432766.815837:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17179:1874258609503104:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787432766.816072:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432766.816105:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301e0bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432766.818588:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609503104 00000100:00100000:1.0:1787432766.818600:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609503104 00000100:00100000:1.0:1787432766.818666:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432766.818691:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17179:x1874258609503104:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787432766.818736:0:18660:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:1.0:1787432766.842605:0:18655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1787432766.842649:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787432766.842655:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787432766.842942:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17179:x1874258609503104:12345-0@lo:5:osp-pre-0-0.0 Request processed in 24247us (26863us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787432766.842953:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432766.843118:0:17179:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787432766.843127:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17179:1874258609503104:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787432766.843143:0:17179:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:2.0:1787432767.631925:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432767.949371:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609503232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787432767.949439:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432767.949495:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609503232 00000100:00100000:2.0:1787432767.950045:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609503232 00000100:00100000:3.0:1787432767.950204:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787432767.950217:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609503232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787432767.950253:0:17160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787432767.950320:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609503232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432767.950326:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787432767.950408:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432767.950419:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609503360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432767.950450:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432767.950524:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609503360 00000100:00100000:3.0:1787432767.950529:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609503360 00000100:00100000:3.0:1787432767.950555:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787432767.950573:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609503360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787432767.950596:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787432767.950632:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609503360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432767.950638:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787432767.950674:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609503360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432767.950924:0:17896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d26d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17896:1874258609503616:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787432767.950953:0:17896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432767.950983:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301e0b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432767.951692:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609503488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432767.951732:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432767.951776:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609503488 00000100:00100000:1.0:1787432767.951780:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609503488 00000100:00100000:1.0:1787432767.951816:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432767.951824:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609503488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787432767.951846:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787432767.951884:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609503488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432767.951890:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432767.951945:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609503488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432767.952143:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609503232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432767.953123:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609503616 00000100:00100000:1.0:1787432767.953132:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609503616 00000100:00100000:1.0:1787432767.953322:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787432767.953332:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17896:x1874258609503616:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787432767.953371:0:18659:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1787432767.989218:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17896:x1874258609503616:12345-0@lo:5:osp-pre-0-1.0 Request processed in 35879us (38255us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787432767.989231:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787432767.990085:0:17896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d26d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17896:1874258609503616:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1787432767.990113:0:17896:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1787432767.991073:0:17896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17896:1874258609503744:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787432767.991138:0:17896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432767.991279:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483026db240 going to sleep for 11 seconds 00000100:00100000:2.0:1787432767.993367:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609503744 00000100:00100000:2.0:1787432767.993389:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609503744 00000100:00100000:2.0:1787432767.993511:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432767.993524:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17896:x1874258609503744:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787432767.993652:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17896:x1874258609503744:12345-0@lo:900:osp-pre-0-1.0 Request processed in 130us (2511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432767.993661:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787432767.994432:0:17896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff948304645180 x1874258609503744/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787432783 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432767.994450:0:17896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17896:1874258609503744:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1787432768.654047:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787432769.103399:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787432769.676533:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787432770.497068:0:19474:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787432770.497073:0:19474:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787432770.497075:0:19474:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787432770.497236:0:19474:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff948301d52800 00000020:01000004:1.0:1787432770.497252:0:19474:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787432770.497266:0:19474:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787432770.497292:0:19474:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff948302688000) 00000020:00000080:1.0:1787432770.497310:0:19474:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787432770.562036:0:19474:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787432770.565505:0:19474:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787432770.565773:0:19474:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787432770.566295:0:19474:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787432770.566519:0:19474:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787432770.566761:0:19474:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787432770.567061:0:19474:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1787432770.568940:0:19474:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787432770.569160:0:19474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787432770.569243:0:19474:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787432770.569256:0:19474:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xca72b3b335640026 00000020:01000004:3.0:1787432770.569263:0:19474:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787432770.569286:0:19474:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.124@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787432770.569289:0:19474:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787432770.569295:0:19474:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787432770.569323:0:19474:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1787432770.569326:0:19474:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.124@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787432770.584983:0:19474:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.124@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787432770.585031:0:19474:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.124@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787432770.585037:0:19474:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787432770.585039:0:19474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787432770.585041:0:19474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432770.585042:0:19474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432770.585043:0:19474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432770.585044:0:19474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432770.585046:0:19474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787432770.585048:0:19474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432770.585049:0:19474:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787432770.585053:0:19474:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787432770.585055:0:19474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787432770.585056:0:19474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787432770.585057:0:19474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432770.585058:0:19474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432770.585060:0:19474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432770.585061:0:19474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432770.585062:0:19474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787432770.585063:0:19474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432770.585064:0:19474:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787432770.585091:0:19474:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787432770.585112:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609503872:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787432770.585529:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.585741:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842e978300 going to sleep for 11 seconds 00000100:00100000:0.0:1787432770.585864:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609503872 00000100:00100000:0.0:1787432770.585874:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609503872 00000100:00100000:0.0:1787432770.586062:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787432770.586073:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:19474:x1874258609503872:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787432770.586104:0:17147:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787432770.586107:0:17147:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787432770.586111:0:17147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787432770.587036:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:19474:x1874258609503872:12345-0@lo:253:mount.lustre.0 Request processed in 961us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432770.587047:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787432770.588191:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609503872:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787432770.588221:0:19474:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787432770.588225:0:19474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787432770.588227:0:19474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787432770.588229:0:19474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432770.588230:0:19474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432770.588231:0:19474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432770.588232:0:19474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432770.588234:0:19474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787432770.588236:0:19474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432770.588237:0:19474:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787432770.588274:0:19474:0:(tgt_mount.c:101:server_register_mount()) register mount ffff948301d52800 from lustre-OST0001 10000000:01000000:2.0:1787432770.588305:0:19474:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787432770.588308:0:19474:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787432770.588317:0:19474:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9483030f0000 local copy 00010000:00010000:2.0:1787432770.588328:0:19474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432770.588630:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609504000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432770.588681:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.588713:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842e978900 going to sleep for 11 seconds 00000100:00100000:1.0:1787432770.591599:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609504000 00000100:00100000:1.0:1787432770.591617:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609504000 00000100:00100000:1.0:1787432770.591731:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787432770.591741:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948402c9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:19474:x1874258609504000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432770.591896:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948402c9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:19474:x1874258609504000:12345-0@lo:501:mount.lustre.0 Request processed in 156us (3213us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787432770.591911:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787432770.593198:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609504000:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787432770.593240:0:19474:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787432770.593278:0:19474:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787432770.593287:0:19474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.593299:0:19474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9483039f0600/0xca72b3b33563fc75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33563fc7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432770.593333:0:19474:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff948301d52800 10000000:01000000:2.0:1787432770.593339:0:19474:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787432770.593345:0:19474:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787432770.593348:0:19474:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787432770.593353:0:19474:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787432770.593356:0:19474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787432770.593400:0:19474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4600/0xca72b3b33564002d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.593408:0:19474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484032e4600/0xca72b3b33564002d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.593434:0:19474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484032e4600/0xca72b3b33564002d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432770.593526:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609504128:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787432770.593585:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.593638:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842e978900 going to sleep for 11 seconds 00000100:00100000:0.0:1787432770.593948:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609504128 00000100:00100000:0.0:1787432770.593956:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609504128 00000100:00100000:1.0:1787432770.594818:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787432770.594830:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948402c9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:19474:x1874258609504128:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432770.594843:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432770.594860:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303850e00/0xca72b3b335640034 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33564002d expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432770.594902:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303850e00/0xca72b3b335640034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33564002d expref: 22 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432770.594924:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303850e00/0xca72b3b335640034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33564002d expref: 22 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432770.594932:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303850e00, rc 0) 00000100:00100000:1.0:1787432770.594992:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948402c9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:19474:x1874258609504128:12345-0@lo:101:mount.lustre.0 Request processed in 164us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432770.594998:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787432770.595995:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609504128:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432770.596020:0:19474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484032e4600/0xca72b3b33564002d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640034 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.596031:0:19474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484032e4600/0xca72b3b33564002d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640034 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787432770.600864:0:19474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787432770.607265:0:19474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432770.609971:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787432770.610042:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787432770.610057:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787432770.610069:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787432770.610079:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787432770.610092:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787432770.610116:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787432770.610122:0:19474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787432770.610285:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609504256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432770.610362:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.610411:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842e978d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432770.610677:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609504256 00000100:00100000:1.0:1787432770.610687:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609504256 00000100:00100000:1.0:1787432770.610751:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787432770.610760:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:19474:x1874258609504256:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432770.610931:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:19474:x1874258609504256:12345-0@lo:501:mount.lustre.0 Request processed in 170us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432770.610938:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787432770.611227:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609504256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432770.611277:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609504384:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787432770.611320:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.611348:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842e978d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787432770.611378:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609504384 00000100:00100000:3.0:1787432770.611390:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609504384 00000100:00100000:3.0:1787432770.611431:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787432770.611439:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:19474:x1874258609504384:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787432770.614769:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:19474:x1874258609504384:12345-0@lo:503:mount.lustre.0 Request processed in 3322us (3440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432770.614785:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787432770.614833:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609504384:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787432770.615361:0:19474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787432770.615457:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609504512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432770.615510:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.615553:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842e978900 going to sleep for 11 seconds 00000100:00100000:1.0:1787432770.615698:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609504512 00000100:00100000:1.0:1787432770.615705:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609504512 00000100:00100000:1.0:1787432770.615762:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787432770.615773:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:19474:x1874258609504512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432770.616486:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:19474:x1874258609504512:12345-0@lo:502:mount.lustre.0 Request processed in 712us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432770.616495:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787432770.616863:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609504512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787432770.617461:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787432770.617496:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787432770.617507:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787432770.617517:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787432770.617526:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787432770.617535:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787432770.618694:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787432770.618727:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787432770.618742:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787432770.618791:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609504640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432770.618872:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432770.618926:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d31cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432770.618961:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609504640 00000100:00100000:1.0:1787432770.618970:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609504640 00000100:00100000:1.0:1787432770.619027:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787432770.619036:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:19474:x1874258609504640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432770.619150:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:19474:x1874258609504640:12345-0@lo:502:mount.lustre.0 Request processed in 114us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432770.619159:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787432770.619446:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609504640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787432770.619498:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787432770.619507:0:19474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1787432770.621094:0:19478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787432770.621104:0:19478:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787432770.621111:0:19478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432770.621113:0:19478:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787432770.621120:0:19478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787432770.621137:0:19478:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9484093b4d28) 00000020:00000080:3.0:1787432770.621202:0:19478:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787432770.621221:0:19478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787432770.621314:0:19478:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948301d52800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787432770.621323:0:19478:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787432770.621330:0:19478:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xca72b3b335640042 00010000:00010000:1.0:1787432770.631649:0:19478:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787432770.632159:0:19478:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1787432770.633984:0:19478:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1787432770.635409:0:19478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787432770.635422:0:19478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432770.635428:0:19478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432770.635431:0:19478:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787432770.635435:0:19478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432770.635439:0:19478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432770.635441:0:19478:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787432770.635444:0:19478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787432770.635446:0:19478:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787432770.635450:0:19478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432770.635452:0:19478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432770.635453:0:19478:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787432770.635455:0:19478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432770.635458:0:19478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432770.635459:0:19478:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787432770.635463:0:19478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787432770.635490:0:19478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432770.635494:0:19478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432770.635496:0:19478:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787432770.635499:0:19478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787432770.640138:0:19474:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787432770.640217:0:19474:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787432770.640238:0:19474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e4600/0xca72b3b33564002d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640034 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432770.640251:0:19474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484032e4600/0xca72b3b33564002d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640034 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432770.640260:0:19474:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948301d52800 from 1 10000000:01000000:1.0:1787432770.640263:0:19474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787432770.640301:0:19474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303850000/0xca72b3b335640049 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432770.640310:0:19474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948303850000/0xca72b3b335640049 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432770.640323:0:19474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948303850000/0xca72b3b335640049 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432770.640349:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609504768:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787432770.640430:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432770.640478:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301f26000 going to sleep for 11 seconds 00000100:00100000:2.0:1787432770.645123:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609504768 00000100:00100000:2.0:1787432770.645143:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609504768 00000100:00100000:2.0:1787432770.645815:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787432770.645826:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:19474:x1874258609504768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432770.645842:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432770.645860:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484032e4200/0xca72b3b335640050 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b335640049 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.645888:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e4200/0xca72b3b335640050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b335640049 expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.645899:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484032e4200/0xca72b3b335640050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b335640049 expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.645920:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e4200, rc 0) 00000100:00100000:2.0:1787432770.646023:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:19474:x1874258609504768:12345-0@lo:101:mount.lustre.0 Request processed in 199us (5593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432770.646030:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787432770.646204:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609504768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432770.646237:0:19474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948303850000/0xca72b3b335640049 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640050 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432770.646248:0:19474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948303850000/0xca72b3b335640049 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640050 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787432770.647660:0:19474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787432770.647996:0:19474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787432770.648259:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787432770.648285:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787432770.648304:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787432770.648309:0:19474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787432770.648624:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609504896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432770.648702:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432770.648744:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d316c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432770.648881:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609504896 00000100:00100000:2.0:1787432770.648891:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609504896 00000100:00100000:2.0:1787432770.648983:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787432770.648994:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:19474:x1874258609504896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432770.649118:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:19474:x1874258609504896:12345-0@lo:501:mount.lustre.0 Request processed in 125us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432770.649126:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787432770.649523:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609504896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432770.649562:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609505024:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787432770.649612:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432770.649645:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d316c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432770.649689:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609505024 00000100:00100000:1.0:1787432770.649695:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609505024 00000100:00100000:1.0:1787432770.649733:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787432770.649741:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:19474:x1874258609505024:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432770.649832:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:19474:x1874258609505024:12345-0@lo:503:mount.lustre.0 Request processed in 92us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432770.649839:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787432770.649917:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609505024:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787432770.650684:0:19474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787432770.650766:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609505152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432770.650814:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432770.650955:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d31600 going to sleep for 11 seconds 00000100:00100000:0.0:1787432770.652518:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609505152 00000100:00100000:0.0:1787432770.652536:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609505152 00000100:00100000:0.0:1787432770.652596:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787432770.652608:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:19474:x1874258609505152:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432770.652820:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:19474:x1874258609505152:12345-0@lo:502:mount.lustre.0 Request processed in 214us (2005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432770.652837:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787432770.656823:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609505152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787432770.657153:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787432770.657252:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787432770.657270:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787432770.657287:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787432770.657304:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787432770.657320:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787432770.657335:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787432770.657351:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787432770.657367:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787432770.657396:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787432770.657416:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787432770.657467:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609505280:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432770.657548:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432770.657593:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301d31600 going to sleep for 11 seconds 00000100:00100000:0.0:1787432770.657888:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609505280 00000100:00100000:0.0:1787432770.657897:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609505280 00000100:00100000:0.0:1787432770.657963:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787432770.657974:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:19474:x1874258609505280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432770.658097:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:19474:x1874258609505280:12345-0@lo:502:mount.lustre.0 Request processed in 125us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432770.658106:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787432770.658353:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609505280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787432770.658424:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1787432770.658437:0:19474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787432770.659753:0:19482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432770.659765:0:19482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432770.659767:0:19482:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787432770.659775:0:19482:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948301d52800 00000020:00000080:0.0:1787432770.659777:0:19482:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787432770.659785:0:19482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432770.659787:0:19482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432770.659797:0:19482:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787432770.659800:0:19482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432770.659803:0:19482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432770.659804:0:19482:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787432770.659807:0:19482:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff948301d52800 00000020:00000080:0.0:1787432770.659809:0:19482:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787432770.659869:0:19482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432770.659873:0:19482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432770.659874:0:19482:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787432770.659877:0:19482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432770.659879:0:19482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432770.659880:0:19482:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787432770.659884:0:19482:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948301d52800 00000020:00000080:0.0:1787432770.659886:0:19482:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787432770.661007:0:19482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432770.661020:0:19482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432770.661022:0:19482:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787432770.661026:0:19482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432770.661029:0:19482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432770.661030:0:19482:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787432770.661033:0:19482:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff948301d52800 00000020:00000080:0.0:1787432770.661035:0:19482:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787432770.661082:0:19482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432770.661085:0:19482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432770.661087:0:19482:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787432770.661090:0:19482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1787432770.662024:0:19474:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787432770.662070:0:19474:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432770.662107:0:19474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948303850000/0xca72b3b335640049 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640050 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.662120:0:19474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948303850000/0xca72b3b335640049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640050 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432770.662216:0:19474:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787432770.662221:0:19474:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff948301d52800 10000000:01000000:2.0:1787432770.662224:0:19474:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff948301d52800 10000000:01000000:2.0:1787432770.662230:0:19474:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787432770.662237:0:19474:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff948301d52800 from 1 10000000:01000000:2.0:1787432770.662240:0:19474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787432770.662287:0:19474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b335640057 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.662296:0:19474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b335640057 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.662309:0:19474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b335640057 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432770.662339:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609505408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787432770.662418:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.662475:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842e978480 going to sleep for 11 seconds 00000100:00100000:1.0:1787432770.662634:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609505408 00000100:00100000:1.0:1787432770.662643:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609505408 00000100:00100000:1.0:1787432770.662698:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787432770.662710:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:19474:x1874258609505408:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432770.662722:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432770.662735:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948303851800/0xca72b3b33564005e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b335640057 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432770.662758:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948303851800/0xca72b3b33564005e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b335640057 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432770.662768:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948303851800/0xca72b3b33564005e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b335640057 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432770.662777:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948303851800, rc 0) 00000100:00100000:1.0:1787432770.662816:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:19474:x1874258609505408:12345-0@lo:101:mount.lustre.0 Request processed in 108us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432770.662822:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787432770.663570:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609505408:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432770.663588:0:19474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b335640057 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33564005e expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.663598:0:19474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b335640057 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33564005e expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787432770.667416:0:19474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1787432770.667715:0:19474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432770.667927:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787432770.667950:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787432770.667961:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787432770.667972:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787432770.667983:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787432770.667993:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787432770.668003:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787432770.668014:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787432770.668040:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787432770.668052:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787432770.668062:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787432770.668072:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787432770.668081:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787432770.668092:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787432770.668102:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787432770.668112:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787432770.668125:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787432770.668138:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787432770.668150:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787432770.668326:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787432770.668347:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787432770.668361:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787432770.668375:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787432770.668390:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787432770.668420:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1787432770.668437:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1787432770.668450:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1787432770.668463:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1787432770.668474:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1787432770.668496:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1787432770.668509:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1787432770.668522:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1787432770.668534:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1787432770.668544:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1787432770.668556:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1787432770.668568:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1787432770.668581:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1787432770.668594:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1787432770.668607:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1787432770.668618:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1787432770.668641:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1787432770.668654:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1787432770.668664:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1787432770.668673:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1787432770.668683:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1787432770.668693:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1787432770.668724:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1787432770.668728:0:19474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1787432770.669272:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609505536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432770.669336:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.669430:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842e978000 going to sleep for 11 seconds 00000100:00100000:1.0:1787432770.680532:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609505536 00000100:00100000:1.0:1787432770.680552:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609505536 00000100:00100000:1.0:1787432770.680619:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787432770.680639:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:19474:x1874258609505536:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432770.680845:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:19474:x1874258609505536:12345-0@lo:501:mount.lustre.0 Request processed in 209us (11507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432770.680856:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787432770.681067:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609505536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432770.681119:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609505664:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432770.681181:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432770.681221:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301f26a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432770.681236:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609505664 00000100:00100000:1.0:1787432770.681239:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609505664 00000100:00100000:1.0:1787432770.681262:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787432770.681267:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:19474:x1874258609505664:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432770.681337:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:19474:x1874258609505664:12345-0@lo:503:mount.lustre.0 Request processed in 69us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432770.681343:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787432770.681481:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609505664:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787432770.682987:0:19474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787432770.683080:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609505792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432770.683147:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432770.683204:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301f26a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432770.683244:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609505792 00000100:00100000:1.0:1787432770.683249:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609505792 00000100:00100000:1.0:1787432770.683280:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787432770.683287:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:19474:x1874258609505792:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432770.683388:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:19474:x1874258609505792:12345-0@lo:502:mount.lustre.0 Request processed in 99us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432770.683402:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787432770.683460:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609505792:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787432770.685129:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787432770.685205:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787432770.685234:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787432770.685249:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787432770.685263:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787432770.685277:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787432770.685291:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787432770.685303:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787432770.685315:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787432770.685327:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787432770.685339:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787432770.685351:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787432770.685364:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787432770.685395:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787432770.685411:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787432770.685423:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787432770.685436:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787432770.685449:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787432770.685461:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787432770.685474:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787432770.687290:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787432770.687377:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787432770.687395:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787432770.687411:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787432770.687426:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1787432770.687440:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1787432770.687454:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1787432770.687466:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1787432770.688280:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1787432770.688318:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1787432770.688335:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1787432770.688350:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1787432770.688364:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1787432770.688378:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1787432770.688392:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1787432770.688960:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1787432770.688977:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1787432770.688991:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1787432770.689002:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1787432770.689013:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1787432770.689026:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1787432770.689040:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1787432770.689054:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1787432770.689066:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1787432770.689078:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1787432770.689106:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1787432770.689137:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1787432770.689150:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1787432770.689242:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609505920:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432770.689326:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432770.689375:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301f26a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432770.689459:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609505920 00000100:00100000:0.0:1787432770.689467:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609505920 00000100:00100000:0.0:1787432770.689517:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787432770.689528:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:19474:x1874258609505920:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432770.689643:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:19474:x1874258609505920:12345-0@lo:502:mount.lustre.0 Request processed in 116us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432770.689651:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787432770.690686:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609505920:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787432770.693047:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1787432770.693103:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1787432770.693154:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609506048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432770.693265:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432770.693307:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609506048 00000100:00100000:1.0:1787432770.693310:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301f26a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432770.693315:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609506048 00000100:00100000:0.0:1787432770.693370:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787432770.693390:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:19474:x1874258609506048:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432770.693504:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:19474:x1874258609506048:12345-0@lo:502:mount.lustre.0 Request processed in 124us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432770.693512:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787432770.693629:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609506048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787432770.693692:0:19474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1787432770.693699:0:19474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787432770.695368:0:19487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787432770.695387:0:19487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff94830268cd28) 00000020:00000080:1.0:1787432770.695415:0:19487:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1787432770.695545:0:19487:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948301d52800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787432770.695550:0:19487:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948301d52800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787432770.695552:0:19487:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948301d52800 3 00010000:00080000:1.0:1787432770.695594:0:19487:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94830347d800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.124@tcp at head 00010000:00010000:0.0:1787432770.700785:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432770.705682:0:19487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1787432770.705905:0:19487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787432770.705952:0:19487:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787432770.705965:0:19487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xca72b3b33564006c 00000100:00080000:1.0:1787432770.705976:0:19487:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787432770.705982:0:19487:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94830347d800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:1.0:1787432770.706027:0:19487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948304644a80 x1874258609506176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787432770.706057:0:19487:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787432770.714596:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432770.714602:0:474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787432770.714606:0:474:0:(import.c:65:import_set_state_nolock()) ffff9484034a6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432770.714614:0:474:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 577 00000100:00080000:2.0:1787432770.714618:0:474:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787432770.714624:0:474:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9484034a6800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432770.714646:0:474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9484348dc700 x1874258609506560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432770.714698:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432770.714701:0:474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787432770.714703:0:474:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432770.714707:0:474:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 577 00000100:00080000:2.0:1787432770.714709:0:474:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787432770.714713:0:474:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94843c7f3800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432770.714722:0:474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff948303908e00 x1874258609507072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787432770.714765:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874258609506176:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787432770.714840:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.714879:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609506560:0@lo:8:kworker.0 00000100:00100000:2.0:1787432770.715067:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.715088:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609507072:0@lo:8:kworker.0 00000100:00100000:2.0:1787432770.715110:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.715141:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609506304:0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.715185:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.715204:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609506944:0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.715243:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.715263:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787432770.715269:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609506432:0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.715290:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.715306:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609507200:0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.715324:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.715359:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609506688:0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.715455:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.715475:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609507328:0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.715494:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.715504:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787432770.715508:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609506816:0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.715524:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.715536:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609507456:0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.715554:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.715576:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609506176 00000100:00100000:2.0:1787432770.715583:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609506176 00000100:00100000:2.0:1787432770.715604:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609507200 00000100:00100000:2.0:1787432770.715607:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609507200 00000100:00100000:2.0:1787432770.715625:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609506688 00000100:00100000:2.0:1787432770.715627:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609506688 00000100:00100000:2.0:1787432770.715636:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609507328 00000100:00100000:2.0:1787432770.715638:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609507328 00000100:00100000:2.0:1787432770.715659:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609507456 00000100:00100000:2.0:1787432770.715661:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609507456 00000100:00100000:2.0:1787432770.715673:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787432770.715680:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609507200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.715723:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609507200:12345-0@lo:400:kworker.0 Request processed in 42us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432770.715729:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787432770.715746:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787432770.715751:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609506688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.715773:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609506688:12345-0@lo:400:kworker.0 Request processed in 23us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432770.715788:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787432770.716005:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787432770.716012:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609507328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.716040:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609507328:12345-0@lo:400:kworker.0 Request processed in 29us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432770.716045:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787432770.716054:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787432770.716060:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609507456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.716079:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609507456:12345-0@lo:400:kworker.0 Request processed in 20us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432770.716085:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787432770.716093:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432770.716097:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874258609506176:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787432770.716116:0:17155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 581 last 0 00000020:00000080:2.0:1787432770.716147:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xca72b3b335640073 00000004:00100000:2.0:1787432770.716160:0:17155:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787432770.716203:0:17155:0:(import.c:65:import_set_state_nolock()) ffff9483039e7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432770.716248:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874258609506176:12345-0@lo:38:llog_process_th.0 Request processed in 149us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432770.716254:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432770.716273:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609506560 00000100:00100000:2.0:1787432770.716276:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609506560 00000100:00100000:2.0:1787432770.716286:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609507072 00000100:00100000:2.0:1787432770.716289:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609507072 00000100:00100000:2.0:1787432770.716310:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609506944 00000100:00100000:2.0:1787432770.716312:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609506944 00000100:00100000:2.0:1787432770.716331:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609506432 00000100:00100000:2.0:1787432770.716333:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609506432 00000100:00100000:2.0:1787432770.716345:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432770.716351:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3641:x1874258609506944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.716377:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3641:x1874258609506944:12345-0@lo:400:kworker.0 Request processed in 27us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432770.716457:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432770.716469:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787432770.716475:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609506432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.716499:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609506432:12345-0@lo:400:kworker.0 Request processed in 26us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432770.716505:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787432770.716513:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787432770.716517:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1874258609506560:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787432770.716545:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1874258609506560:12345-0@lo:8:kworker.0 Request processed in 26us (1478us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787432770.716550:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787432770.716558:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432770.716562:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1874258609507072:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787432770.716585:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1874258609507072:12345-0@lo:8:kworker.0 Request processed in 21us (1474us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787432770.716590:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432770.716608:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609506304 00000100:00100000:2.0:1787432770.716611:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609506304 00000100:00100000:2.0:1787432770.716636:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609506816 00000100:00100000:2.0:1787432770.716639:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609506816 00000100:00100000:2.0:1787432770.716648:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787432770.716654:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609506304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.716688:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609506304:12345-0@lo:400:kworker.0 Request processed in 34us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432770.716694:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787432770.716704:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787432770.716709:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609506816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.716741:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609506816:12345-0@lo:400:kworker.0 Request processed in 32us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432770.716746:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1787432770.716776:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787432770.716780:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787432770.716782:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432770.716819:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609506816:0@lo:400:kworker.0 00010000:00080000:2.0:1787432770.716832:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303908700 x1874258609507456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432770.716842:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609507456:0@lo:400:kworker.0 00010000:00080000:2.0:1787432770.716851:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484348dd500 x1874258609506688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432770.716859:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609506688:0@lo:400:kworker.0 00010000:00080000:2.0:1787432770.716867:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303909180 x1874258609507328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432770.716875:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609507328:0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.717042:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609506432:0@lo:400:kworker.0 00010000:00080000:2.0:1787432770.717054:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830390a300 x1874258609507200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432770.717069:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609507200:0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.717079:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609506304:0@lo:400:kworker.0 00000100:00100000:2.0:1787432770.717090:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609506944:0@lo:400:kworker.0 00010000:00080000:2.0:1787432770.717117:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948304644a80 x1874258609506176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432770.717125:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787432770.717131:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787432770.717137:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787432770.717141:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787432770.717144:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94830347d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787432770.717149:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1874258609506176:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787432770.717157:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787432770.717160:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484034a6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787432770.717182:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787432770.717185:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609506560:0@lo:8:kworker.0 00000100:00100000:2.0:1787432770.717193:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787432770.717196:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787432770.717198:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787432770.717201:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609507072:0@lo:8:kworker.0 00000020:01000004:0.0:1787432770.718502:0:19487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787432770.718520:0:19487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff948433618000) 00000020:00000080:0.0:1787432770.718543:0:19487:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1787432770.718643:0:19487:0:(tgt_mount.c:153:server_get_mount()) get mount ffff948301d52800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787432770.718648:0:19487:0:(tgt_mount.c:187:server_put_mount()) put mount ffff948301d52800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787432770.718652:0:19487:0:(obd_mount.c:710:lustre_put_lsi()) put ffff948301d52800 3 00010000:00080000:0.0:1787432770.718682:0:19487:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94843c7f6800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.124@tcp at head 00010000:00010000:0.0:1787432770.723729:0:19487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1787432770.724880:0:19487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1787432770.725511:0:19487:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787432770.725530:0:19487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xca72b3b335640081 00000100:00080000:0.0:1787432770.725542:0:19487:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787432770.725548:0:19487:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff94843c7f6800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:0.0:1787432770.725589:0:19487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9484359eb800 x1874258609507584/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432770.725619:0:19487:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787432770.725721:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1874258609507584:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787432770.725802:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432770.725900:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609507584 00000100:00100000:0.0:1787432770.725979:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609507584 00000100:00100000:0.0:1787432770.726055:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787432770.726064:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1874258609507584:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787432770.726091:0:17155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 581 last 0 00000020:00000080:0.0:1787432770.726143:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xca72b3b335640088 00000004:00100000:0.0:1787432770.726184:0:17155:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787432770.726230:0:17155:0:(import.c:65:import_set_state_nolock()) ffff948434886000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432770.726286:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874258609507584:12345-0@lo:38:llog_process_th.0 Request processed in 221us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432770.726293:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:1.0:1787432770.730183:0:19487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00010000:00080000:3.0:1787432770.730395:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484359eb800 x1874258609507584/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432770.730410:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787432770.730423:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787432770.730432:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787432770.730437:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787432770.730441:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7f6800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787432770.730449:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1874258609507584:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1787432770.732316:0:19474:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787432770.732370:0:19474:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787432770.732393:0:19474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b335640057 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33564005e expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432770.732406:0:19474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff9484032e5a00/0xca72b3b335640057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33564005e expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787432770.732466:0:19474:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787432770.732472:0:19474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787432770.732473:0:19474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432770.732474:0:19474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432770.732475:0:19474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432770.732612:0:19474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432770.732615:0:19474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787432770.732617:0:19474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432770.732619:0:19474:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787432770.732623:0:19474:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787432770.732625:0:19474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787432770.732626:0:19474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787432770.732627:0:19474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432770.732628:0:19474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432770.732629:0:19474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432770.732630:0:19474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432770.732631:0:19474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787432770.732631:0:19474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432770.732632:0:19474:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787432770.732667:0:19474:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787432770.732692:0:19474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609507712:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787432770.733625:0:19474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432770.733684:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609507712 00000100:00100000:1.0:1787432770.733693:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609507712 00000100:00100000:1.0:1787432770.733752:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787432770.733762:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:19474:x1874258609507712:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787432770.733874:0:17149:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787432770.733890:0:17149:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787432770.734026:0:19474:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301f263c0 going to sleep for 11 seconds 20000000:01000000:2.0:1787432770.740555:0:17149:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787432770.740571:0:17149:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787432770.740638:0:17170:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787432770.740643:0:17170:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787432770.740677:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9484032e5400/0xca72b3b33564008f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.740699:0:17170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948303850600/0xca72b3b33563ff38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ff31 expref: 24 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.740707:0:17170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948304488800/0xca72b3b33563ff46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563ff3f expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.740714:0:17170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9484032e5400/0xca72b3b33564008f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.740760:0:17170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948304488800/0xca72b3b33563ff46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563ff3f expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.740775:0:17170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948304488800/0xca72b3b33563ff46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563ff3f expref: 24 pid: 17148 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432770.740790:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17170:1874258609507840:0@lo:104: 00000100:00100000:2.0:1787432770.740858:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432770.740925:0:17170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948303850600/0xca72b3b33563ff38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563ff31 expref: 24 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.740934:0:17170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948303850600/0xca72b3b33563ff38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563ff31 expref: 24 pid: 17149 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432770.740942:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17170:1874258609507968:0@lo:104: 00000100:00100000:2.0:1787432770.740964:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.740990:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842e978e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432770.741027:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609507840 00000100:00100000:2.0:1787432770.741035:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609507840 00000100:00100000:2.0:1787432770.741088:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609507968 00000100:00100000:2.0:1787432770.741093:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609507968 00000100:00100000:2.0:1787432770.741106:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787432770.741114:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+4:17170:x1874258609507840:12345-0@lo:104: 00010000:00010000:2.0:1787432770.741127:0:17137:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563ff3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ff46 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.741223:0:17137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787432770.741230:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+4:17170:x1874258609507840:12345-0@lo:104: Request processed in 116us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432770.741236:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787432770.741253:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787432770.741259:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+3:17170:x1874258609507968:12345-0@lo:104: 00010000:00010000:2.0:1787432770.741267:0:17137:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948304488400/0xca72b3b33563ff31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ff38 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.741298:0:17137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787432770.741304:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+3:17170:x1874258609507968:12345-0@lo:104: Request processed in 45us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432770.741310:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787432770.741325:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787432770.741330:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563ff3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ff46 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.741337:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489200 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432770.741340:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563ff3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563ff46 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.741347:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563ff3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563ff46 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432770.741362:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563ff3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563ff46 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432770.741368:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787432770.741969:0:17142:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563ff3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ff46 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.741978:0:17142:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432770.741996:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563ff3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ff46 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.742004:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b33563ff3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ff46 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.742019:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432770.742023:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948304488400/0xca72b3b33563ff31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563ff38 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.742029:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432770.742032:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948304488400/0xca72b3b33563ff31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563ff38 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.742041:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948304488400/0xca72b3b33563ff31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563ff38 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432770.742046:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948304488400/0xca72b3b33563ff31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563ff38 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432770.742051:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787432770.742073:0:17142:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948304488400/0xca72b3b33563ff31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ff38 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.742079:0:17142:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432770.742086:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948304488400/0xca72b3b33563ff31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ff38 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.742092:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948304488400/0xca72b3b33563ff31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563ff38 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.742107:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432770.742109:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432770.742111:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432770.742134:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3641:1874258609508096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432770.742233:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432770.742291:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:19474:x1874258609507712:12345-0@lo:253:mount.lustre.0 Request processed in 8530us (8667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432770.742299:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787432770.742349:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17170:1874258609507840:0@lo:104: 00000100:00100000:1.0:1787432770.742358:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17170:1874258609507968:0@lo:104: 00010000:00010000:1.0:1787432770.742399:0:17170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9484032e5400/0xca72b3b33564008f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432770.742429:0:19474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:19474:1874258609507712:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787432770.742441:0:19474:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787432770.742444:0:19474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787432770.742446:0:19474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787432770.742448:0:19474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432770.742449:0:19474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432770.742450:0:19474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432770.742452:0:19474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432770.742453:0:19474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787432770.742455:0:19474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432770.742457:0:19474:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787432770.742468:0:19474:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787432770.743792:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.743853:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432770.743866:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3641:1874258609508224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432770.744580:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609508096 00000100:00100000:0.0:1787432770.744589:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609508096 00010000:00010000:0.0:1787432770.744624:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948304488800/0xca72b3b33563ff46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ff3f expref: 24 pid: 17148 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432770.744672:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787432770.744682:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3641:x1874258609508096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432770.744697:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432770.744703:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948304488800/0xca72b3b33563ff46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ff3f expref: 24 pid: 17148 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432770.744716:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948304488800/0xca72b3b33563ff46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563ff3f expref: 24 pid: 17148 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432770.744732:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948304488800/0xca72b3b33563ff46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563ff3f expref: 24 pid: 17148 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432770.744747:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:3.0:1787432770.746200:0:19474:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1787432770.748476:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:3641:x1874258609508096:12345-0@lo:103:ldlm_bl.0 Request processed in 3785us (4677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432770.748494:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00002000:00080000:1.0:1787432770.749224:0:19474:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787432770.749232:0:19474:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787432770.749268:0:19474:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787432770.749322:0:19474:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.124@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787432770.749342:0:19474:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787432770.749367:0:19474:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787432770.750380:0:19474:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787432770.750628:0:19474:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787432770.757039:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.757119:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3641:1874258609508096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432770.757228:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609508224 00000100:00100000:2.0:1787432770.757236:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609508224 00010000:00010000:2.0:1787432770.757268:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948303850600/0xca72b3b33563ff38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ff31 expref: 23 pid: 17149 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432770.757301:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787432770.757310:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483045e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:3641:x1874258609508224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432770.757324:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432770.757330:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948303850600/0xca72b3b33563ff38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563ff31 expref: 23 pid: 17149 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.757359:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948303850600/0xca72b3b33563ff38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563ff31 expref: 23 pid: 17149 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.757376:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303850600/0xca72b3b33563ff38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563ff31 expref: 23 pid: 17149 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.758412:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9484032e5400/0xca72b3b33564008f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.758421:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e5400/0xca72b3b33564008f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787432770.758438:0:17139:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.017795831s 00010000:00010000:2.0:1787432770.758444:0:17139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9484032e5400/0xca72b3b33564008f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.758452:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9484032e5400/0xca72b3b33564008f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.758460:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9484032e5400/0xca72b3b33564008f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.758467:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9484032e5400/0xca72b3b33564008f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.758473:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e5400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432770.758477:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9484032e5400/0xca72b3b33564008f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.758484:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9484032e5400/0xca72b3b33564008f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.758512:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9484032e5400/0xca72b3b33564008f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.758526:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432770.758598:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483045e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:3641:x1874258609508224:12345-0@lo:103:ldlm_bl.0 Request processed in 1287us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432770.758607:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787432770.758644:0:17170:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9484032e5400/0xca72b3b33564008f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.758652:0:17170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9484032e5400/0xca72b3b33564008f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432770.758659:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e5400/0xca72b3b33564008f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432770.758700:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3641:1874258609508224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432771.723488:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787432771.778723:0:19541:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432771.779734:0:19541:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787432772.043796:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432772.043822:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609508352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432772.043902:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432772.043949:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609508352 00000100:00100000:0.0:1787432772.043956:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609508352 00000100:00100000:0.0:1787432772.044010:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432772.044020:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609508352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432772.044048:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787432772.044089:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609508352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432772.044096:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787432772.044124:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432772.044815:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609508352:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1787432772.555764:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787432772.555774:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94843f837000 from 10 10000000:01000000:0.0:1787432772.555780:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787432772.555854:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b335640096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432772.555878:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b335640096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432772.555891:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b335640096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432772.555947:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609508480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787432772.556051:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432772.556095:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841223ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432772.556223:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609508480 00000100:00100000:2.0:1787432772.556232:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609508480 00000100:00100000:2.0:1787432772.556311:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787432772.556336:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403060850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:17151:x1874258609508480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432772.556360:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432772.556376:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9484032e5800/0xca72b3b33564009d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b335640096 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432772.556423:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9484032e5800/0xca72b3b33564009d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b335640096 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432772.556454:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9484032e5800/0xca72b3b33564009d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b335640096 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432772.556463:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484032e5800, rc 0) 00000100:00100000:2.0:1787432772.556510:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403060850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:17151:x1874258609508480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432772.556517:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787432772.556633:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609508480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432772.556650:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b335640096 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33564009d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432772.556658:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b335640096 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b33564009d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432772.556714:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609508608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787432772.556751:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432772.556770:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841de44540 going to sleep for 11 seconds 00000100:00100000:2.0:1787432772.556936:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609508608 00000100:00100000:2.0:1787432772.556940:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609508608 00000100:00100000:2.0:1787432772.557009:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787432772.557018:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:17151:x1874258609508608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787432772.557031:0:17149:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787432772.557050:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787432772.557053:0:17149:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1787432772.557229:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:17151:x1874258609508608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 212us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432772.557237:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787432772.557454:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609508608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787432772.557516:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787432772.557524:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b335640096 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33564009d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432772.557532:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948304489200/0xca72b3b335640096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b33564009d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432772.557541:0:17151:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787432772.557544:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9483038e1000 from 10 10000000:01000000:3.0:1787432772.557546:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787432772.557566:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b3356400a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432772.557583:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b3356400a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432772.557591:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b3356400a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432772.557604:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609508736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432772.557631:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432772.557655:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841de44540 going to sleep for 11 seconds 00000100:00100000:3.0:1787432772.557669:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609508736 00000100:00100000:3.0:1787432772.557672:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609508736 00000100:00100000:3.0:1787432772.557692:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787432772.557698:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:17151:x1874258609508736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432772.557706:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432772.557716:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94843f85f800/0xca72b3b3356400ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b3356400a4 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432772.557730:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94843f85f800/0xca72b3b3356400ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b3356400a4 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432772.557738:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94843f85f800/0xca72b3b3356400ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b3356400a4 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432772.557746:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85f800, rc 0) 00000100:00100000:3.0:1787432772.557775:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:17151:x1874258609508736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432772.557781:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787432772.557856:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609508736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432772.557867:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b3356400a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356400ab expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432772.557889:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b3356400a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b3356400ab expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432772.557954:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609508864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787432772.557983:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432772.558017:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841de44540 going to sleep for 11 seconds 00000100:00100000:3.0:1787432772.558048:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609508864 00000100:00100000:3.0:1787432772.558064:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609508864 00000100:00100000:3.0:1787432772.558102:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787432772.558130:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:17151:x1874258609508864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787432772.558208:0:17147:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787432772.558222:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787432772.558225:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1787432772.558370:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:17151:x1874258609508864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 240us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432772.558389:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787432772.558434:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609508864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787432772.558503:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787432772.558509:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b3356400a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356400ab expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432772.558530:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85e800/0xca72b3b3356400a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b3356400ab expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432772.751973:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432773.068367:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609509120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432773.068448:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432773.068482:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609508992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432773.068505:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432773.068542:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609509248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432773.068567:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432773.068606:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609509120 00000100:00100000:1.0:1787432773.068613:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609509120 00000100:00100000:1.0:1787432773.068662:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609508992 00000100:00100000:1.0:1787432773.068665:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609508992 00000100:00100000:1.0:1787432773.068682:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787432773.068691:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609509120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787432773.068723:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787432773.068771:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609509120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432773.068778:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787432773.068796:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787432773.068803:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609508992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787432773.068819:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787432773.068847:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609508992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432773.068853:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787432773.068877:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609509248 00000100:00100000:1.0:1787432773.068880:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609509248 00000100:00100000:1.0:1787432773.068915:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787432773.068922:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1874258609509248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787432773.068936:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787432773.068966:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1874258609509248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432773.068972:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787432773.068991:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432773.069026:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609509248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432773.070280:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609509120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787432773.070297:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609508992:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1787432773.074773:0:18655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00010000:00010000:3.0:1787432773.771981:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432774.798247:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787432775.244524:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787432775.823554:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787432776.139350:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432776.139357:0:474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787432776.139361:0:474:0:(import.c:65:import_set_state_nolock()) ffff9484034a6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432776.139373:0:474:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9484034a6800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432776.139408:0:474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9483045e2d80 x1874258609509760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432776.139443:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432776.139446:0:474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787432776.139448:0:474:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432776.139452:0:474:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff94843c7f3800 using connection 192.168.204.124@tcp/0@lo 00000100:00100000:2.0:1787432776.139462:0:474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9484348dd500 x1874258609510272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787432776.139515:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609509376:0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.139582:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432776.139630:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609510016:0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.139655:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432776.139674:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609510656:0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.139697:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432776.139721:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787432776.139727:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609509888:0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.139749:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432776.139766:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609510528:0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.139784:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432776.139820:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609509504:0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.139841:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432776.139858:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609510144:0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.139879:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432776.139894:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609510784:0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.139923:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432776.139941:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787432776.139946:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609509632:0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.139964:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432776.139981:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609510400:0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.139999:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432776.140007:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609510912:0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.140125:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432776.140150:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609509760:0@lo:8:kworker.0 00000100:00100000:2.0:1787432776.140197:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432776.140215:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609510272:0@lo:8:kworker.0 00000100:00100000:2.0:1787432776.140233:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432776.140267:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609509376 00000100:00100000:2.0:1787432776.140275:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609509376 00000100:00100000:2.0:1787432776.140328:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787432776.140339:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3642:x1874258609509376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.140386:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3642:x1874258609509376:12345-0@lo:400:kworker.0 Request processed in 49us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432776.140393:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787432776.140425:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609510016 00000100:00100000:2.0:1787432776.140428:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609510016 00000100:00100000:2.0:1787432776.140452:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609509504 00000100:00100000:2.0:1787432776.140455:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609509504 00000100:00100000:2.0:1787432776.140468:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787432776.140475:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609510016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.140510:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609510016:12345-0@lo:400:kworker.0 Request processed in 36us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432776.140527:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787432776.140539:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787432776.140546:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609509504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.140579:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609509504:12345-0@lo:400:kworker.0 Request processed in 34us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432776.140585:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787432776.140602:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609510656 00000100:00100000:2.0:1787432776.140605:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609510656 00000100:00100000:2.0:1787432776.140634:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609509888 00000100:00100000:2.0:1787432776.140637:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609509888 00000100:00100000:2.0:1787432776.140646:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609510528 00000100:00100000:2.0:1787432776.140648:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609510528 00000100:00100000:2.0:1787432776.140659:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609510784 00000100:00100000:2.0:1787432776.140662:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609510784 00000100:00100000:2.0:1787432776.140672:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609510400 00000100:00100000:2.0:1787432776.140675:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609510400 00000100:00100000:2.0:1787432776.140684:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609510912 00000100:00100000:2.0:1787432776.140686:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609510912 00000100:00100000:2.0:1787432776.140701:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787432776.140706:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609510656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.142214:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609510656:12345-0@lo:400:kworker.0 Request processed in 1497us (2505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432776.142228:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787432776.142258:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787432776.142269:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609509888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.142301:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874258609509888:12345-0@lo:400:kworker.0 Request processed in 37us (2551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432776.142307:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787432776.142333:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787432776.142340:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609510528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.142367:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874258609510528:12345-0@lo:400:kworker.0 Request processed in 28us (2582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432776.142373:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787432776.142385:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787432776.142392:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609510784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.142419:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609510784:12345-0@lo:400:kworker.0 Request processed in 28us (2495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432776.142424:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787432776.142436:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787432776.142442:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609510400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.142472:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874258609510400:12345-0@lo:400:kworker.0 Request processed in 30us (2472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432776.142478:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787432776.142489:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787432776.142496:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609510912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.142522:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874258609510912:12345-0@lo:400:kworker.0 Request processed in 27us (2397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432776.142528:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787432776.142565:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609510144 00000100:00100000:2.0:1787432776.142571:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609510144 00000100:00100000:2.0:1787432776.142599:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609509632 00000100:00100000:2.0:1787432776.142601:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609509632 00000100:00100000:2.0:1787432776.142612:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609509760 00000100:00100000:2.0:1787432776.142614:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609509760 00000100:00100000:2.0:1787432776.142622:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609510272 00000100:00100000:2.0:1787432776.142630:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609510272 00000100:00100000:2.0:1787432776.142642:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787432776.142647:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609510144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.142678:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609510144:12345-0@lo:400:kworker.0 Request processed in 31us (2798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432776.142684:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787432776.142695:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787432776.142701:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609509632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.142728:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609509632:12345-0@lo:400:kworker.0 Request processed in 27us (2762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432776.142733:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787432776.142744:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787432776.142748:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1874258609509760:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787432776.142772:0:19127:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:2.0:1787432776.142797:0:19127:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xca72b3b3356400b2 00002000:00100000:2.0:1787432776.142810:0:19127:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9483039e0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787432776.142815:0:19127:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787432776.142818:0:19127:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787432776.143006:0:19127:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787432776.143296:0:19127:0:(import.c:65:import_set_state_nolock()) ffff9483039e0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432776.143344:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1874258609509760:12345-0@lo:8:kworker.0 Request processed in 594us (3146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432776.143352:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787432776.143366:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432776.143370:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1874258609510272:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787432776.143388:0:19127:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:2.0:1787432776.143414:0:19127:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xca72b3b3356400b9 00002000:00100000:2.0:1787432776.143421:0:19127:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9483039e4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787432776.143424:0:19127:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1787432776.143426:0:19127:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787432776.143453:0:19127:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787432776.143465:0:19127:0:(import.c:65:import_set_state_nolock()) ffff9483039e5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432776.143492:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3640:x1874258609510272:12345-0@lo:8:kworker.0 Request processed in 120us (3257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432776.143498:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787432776.143533:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787432776.143538:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787432776.143541:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787432776.143569:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9483045e2d80 x1874258609509760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787432801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787432776.143586:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787432776.143593:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787432776.143598:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787432776.143601:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9484034a6800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787432776.143624:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787432776.143629:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1874258609509760:0@lo:8:kworker.0 00010000:00080000:2.0:1787432776.143641:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484348dd500 x1874258609510272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787432801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787432776.143794:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787432776.143799:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787432776.143803:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787432776.143804:0:3640:0:(import.c:65:import_set_state_nolock()) ffff94843c7f3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787432776.143823:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787432776.143835:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1874258609510272:0@lo:8:kworker.0 00000004:00080000:2.0:1787432776.143902:0:17181:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1787432776.143923:0:17181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304460e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17181:1874258609511168:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787432776.143955:0:17181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432776.143975:0:17181:0:(client.c:2715:ptlrpc_set_wait()) set ffff9483027153c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432776.143989:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609511040:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1787432776.144123:0:17898:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787432776.144138:0:17898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359eaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17898:1874258609511424:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1787432776.144182:0:17898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432776.144199:0:17898:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841223b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432776.144212:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609511168 00000100:00100000:0.0:1787432776.144216:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609511168 00000100:00100000:0.0:1787432776.144248:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609511424 00000100:00100000:0.0:1787432776.144251:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609511424 00000100:00100000:0.0:1787432776.144269:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787432776.144275:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17181:x1874258609511168:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787432776.144496:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787432776.144509:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17898:x1874258609511424:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:0.0:1787432776.144537:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432776.144809:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432776.144843:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432776.144850:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609511296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432776.144876:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432776.144914:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609511040 00000100:00100000:2.0:1787432776.144918:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609511040 00000100:00100000:2.0:1787432776.144937:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609511296 00000100:00100000:2.0:1787432776.144939:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609511296 00000100:00100000:2.0:1787432776.144950:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432776.144956:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874258609511040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432776.144974:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787432776.145141:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874258609511040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432776.145149:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432776.145181:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787432776.145188:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1874258609511296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787432776.145197:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787432776.145222:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1874258609511296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432776.145228:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787432776.145270:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484359e9c00 x1874258609511296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432776.145286:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609511296:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787432776.145294:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948304460380 x1874258609511040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432776.145304:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609511040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432776.145341:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609509632:0@lo:400:kworker.0 00010000:00080000:2.0:1787432776.145355:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303908e00 x1874258609510400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432776.145363:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874258609510400:0@lo:400:kworker.0 00010000:00080000:2.0:1787432776.145375:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303908700 x1874258609510912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432776.145382:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1874258609510912:0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.145393:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609509504:0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.145405:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1787432776.145415:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609510144:0@lo:400:kworker.0 00010000:00080000:2.0:1787432776.145425:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303909180 x1874258609510784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432776.145432:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609510784:0@lo:400:kworker.0 00010000:00080000:2.0:1787432776.145466:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484348dc700 x1874258609509888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432776.145487:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874258609509888:0@lo:400:kworker.0 00010000:00080000:2.0:1787432776.145502:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830390bb80 x1874258609510528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432776.145510:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1874258609510528:0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.145521:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3642:1874258609509376:0@lo:400:kworker.0 00000100:00100000:2.0:1787432776.145531:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609510016:0@lo:400:kworker.0 00010000:00080000:2.0:1787432776.145541:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94830390a300 x1874258609510656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432776.145549:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830390a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609510656:0@lo:400:kworker.0 00000004:00080000:3.0:1787432776.146143:0:17180:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787432776.146241:0:17180:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 587238075465ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787432776.146247:0:17180:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1787432776.147852:0:17134:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787432776.148363:0:17897:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787432776.148449:0:17897:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 587240283672ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787432776.148457:0:17897:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00002000:00080000:2.0:1787432776.150812:0:18660:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787432776.150825:0:18660:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1787432776.150832:0:18660:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00080000:1.0:1787432776.157570:0:18659:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1787432776.157586:0:18659:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787432776.157674:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17898:x1874258609511424:12345-0@lo:7:osp-pre-1-1.0 Request processed in 13161us (13487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432776.157684:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787432776.157906:0:17898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9484359eaa00 x1874258609511424/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787432792 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432776.157923:0:17898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484359eaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17898:1874258609511424:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1787432776.157937:0:17898:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787432776.157978:0:17898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17898:1874258609511552:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787432776.158083:0:17898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432776.158119:0:17898:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb11840 going to sleep for 11 seconds 00000100:00100000:3.0:1787432776.158137:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609511552 00000100:00100000:3.0:1787432776.158143:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609511552 00000100:00100000:3.0:1787432776.158205:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787432776.158214:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17898:x1874258609511552:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787432776.158240:0:18661:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1787432776.158272:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17898:x1874258609511552:12345-0@lo:5:osp-pre-1-1.0 Request processed in 59us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432776.158279:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787432776.158304:0:17898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948409d24700 x1874258609511552/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787432792 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432776.158314:0:17898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17898:1874258609511552:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787432776.158323:0:17898:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787432776.158347:0:17898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17898:1874258609511680:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787432776.158377:0:17898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432776.158391:0:17898:0:(client.c:2715:ptlrpc_set_wait()) set ffff94842eb11840 going to sleep for 11 seconds 00000100:00100000:3.0:1787432776.158405:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609511680 00000100:00100000:3.0:1787432776.158409:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609511680 00000100:00100000:3.0:1787432776.158429:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787432776.158436:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17898:x1874258609511680:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787432776.158460:0:19127:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:2.0:1787432776.168869:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787432776.168881:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc1a3282/0xca72b3b3356400c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.168898:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=587s v=(0 0) 00010000:00010000:2.0:1787432776.168903:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432776.168909:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1a3282/0xca72b3b3356400c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.168926:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc1a3282/0xca72b3b3356400c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.168947:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc1a3282/0xca72b3b3356400c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.168956:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1a3282/0xca72b3b3356400c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.168976:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787432776.169378:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787432776.169384:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001539c1e5/0xca72b3b3356400c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.169392:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=587s v=(0 0) 00010000:00010000:2.0:1787432776.169395:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432776.169399:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001539c1e5/0xca72b3b3356400c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.169407:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001539c1e5/0xca72b3b3356400c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.169415:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001539c1e5/0xca72b3b3356400c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.169422:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001539c1e5/0xca72b3b3356400c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.169451:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787432776.169464:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787432776.169470:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc1a3282/0xca72b3b3356400c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.169477:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e5000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432776.169481:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc1a3282/0xca72b3b3356400c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.169490:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc1a3282/0xca72b3b3356400c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.169506:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc1a3282/0xca72b3b3356400c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.169513:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc1a3282/0xca72b3b3356400c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.169532:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432776.169535:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001539c1e5/0xca72b3b3356400c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.169541:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484032e5400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432776.169544:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001539c1e5/0xca72b3b3356400c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.169562:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001539c1e5/0xca72b3b3356400c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.169573:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001539c1e5/0xca72b3b3356400c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.169579:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001539c1e5/0xca72b3b3356400c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.169591:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432776.169592:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432776.169594:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787432776.171332:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787432776.171344:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c3a21f9/0xca72b3b3356400ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.171359:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=587s v=(0 0) 00010000:00010000:2.0:1787432776.171364:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432776.171370:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c3a21f9/0xca72b3b3356400ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.171383:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c3a21f9/0xca72b3b3356400ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.171392:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c3a21f9/0xca72b3b3356400ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.171406:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c3a21f9/0xca72b3b3356400ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787432776.171524:0:17886:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00010000:2.0:1787432776.171657:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787432776.172355:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787432776.172362:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006913312b/0xca72b3b3356400d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.172372:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=587s v=(0 0) 00010000:00010000:2.0:1787432776.172375:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432776.172380:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006913312b/0xca72b3b3356400d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.172391:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006913312b/0xca72b3b3356400d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.172399:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006913312b/0xca72b3b3356400d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.172406:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006913312b/0xca72b3b3356400d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.175220:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787432776.175234:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c3a21f9/0xca72b3b3356400ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.175248:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f04a00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432776.175254:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c3a21f9/0xca72b3b3356400ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.175264:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c3a21f9/0xca72b3b3356400ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.175288:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c3a21f9/0xca72b3b3356400ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.175297:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c3a21f9/0xca72b3b3356400ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.175323:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432776.175327:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006913312b/0xca72b3b3356400d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.175346:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f05a00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432776.175350:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006913312b/0xca72b3b3356400d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.175358:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006913312b/0xca72b3b3356400d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.175369:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006913312b/0xca72b3b3356400d5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.175377:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432776.175379:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432776.175381:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432776.177125:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787432776.177137:0:18660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006913312b/0xca72b3b3356400d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.177560:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787432776.178199:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787432776.178210:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5238e05/0xca72b3b3356400dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.178227:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=587s v=(0 0) 00010000:00010000:2.0:1787432776.178233:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432776.178240:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5238e05/0xca72b3b3356400dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.178254:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5238e05/0xca72b3b3356400dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.178265:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5238e05/0xca72b3b3356400dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.178274:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5238e05/0xca72b3b3356400dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.178293:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432776.178641:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432776.178649:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5238e05/0xca72b3b3356400dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.178657:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f04c00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432776.178662:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5238e05/0xca72b3b3356400dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.178671:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5238e05/0xca72b3b3356400dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.178691:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5238e05/0xca72b3b3356400dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.178699:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5238e05/0xca72b3b3356400dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.178721:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432776.178722:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432776.178724:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432776.178824:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787432776.180287:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787432776.180299:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f17c82b8/0xca72b3b3356400e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.180315:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=587s v=(0 0) 00010000:00010000:2.0:1787432776.180320:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432776.180333:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f17c82b8/0xca72b3b3356400e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.180348:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f17c82b8/0xca72b3b3356400e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.180359:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f17c82b8/0xca72b3b3356400e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.180368:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f17c82b8/0xca72b3b3356400e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.180385:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787432776.183802:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787432776.183814:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b92b1d69/0xca72b3b3356400ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.183831:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=587s v=(0 0) 00010000:00010000:2.0:1787432776.183836:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432776.183843:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b92b1d69/0xca72b3b3356400ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.183918:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b92b1d69/0xca72b3b3356400ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.183930:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b92b1d69/0xca72b3b3356400ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.183952:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b92b1d69/0xca72b3b3356400ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.183973:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787432776.183985:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787432776.183991:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f17c82b8/0xca72b3b3356400e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.183998:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f04000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432776.184002:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f17c82b8/0xca72b3b3356400e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.184011:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f17c82b8/0xca72b3b3356400e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.184028:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f17c82b8/0xca72b3b3356400e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.184036:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f17c82b8/0xca72b3b3356400e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.184042:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432776.184053:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432776.184055:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432776.184056:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432776.185923:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787432776.185938:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000487166b3/0xca72b3b3356400f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.185956:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=587s v=(0 0) 00010000:00010000:3.0:1787432776.185960:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432776.185966:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000487166b3/0xca72b3b3356400f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.185981:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000487166b3/0xca72b3b3356400f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.185991:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000487166b3/0xca72b3b3356400f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.185998:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000487166b3/0xca72b3b3356400f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.186036:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432776.186110:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432776.186122:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000487166b3/0xca72b3b3356400f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.186131:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fe00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:2.0:1787432776.186135:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000487166b3/0xca72b3b3356400f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.186144:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000487166b3/0xca72b3b3356400f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.186181:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000487166b3/0xca72b3b3356400f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.186189:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000487166b3/0xca72b3b3356400f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432776.186208:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432776.186210:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432776.186211:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432776.187059:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432776.187063:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432776.187065:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432776.187625:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b92b1d69/0xca72b3b3356400ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.187649:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f05000 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432776.187653:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b92b1d69/0xca72b3b3356400ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.187663:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b92b1d69/0xca72b3b3356400ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.187680:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b92b1d69/0xca72b3b3356400ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.187687:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b92b1d69/0xca72b3b3356400ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.187704:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432776.187705:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432776.187707:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432776.187786:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432776.187792:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b3356400f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.190833:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1787432776.190839:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432776.190847:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b3356400f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.190909:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b3356400f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.190931:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b3356400f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.190938:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b3356400f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.190966:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787432776.192676:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432776.192688:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000205803ae/0xca72b3b3356400ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.192704:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1787432776.192708:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432776.192714:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000205803ae/0xca72b3b3356400ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.192726:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000205803ae/0xca72b3b3356400ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.192735:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000205803ae/0xca72b3b3356400ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.192742:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000205803ae/0xca72b3b3356400ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.192832:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787432776.193286:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432776.193292:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b335640106 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.193302:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1787432776.193305:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432776.193310:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b335640106 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.193320:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b335640106 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.193328:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b335640106 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.193336:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b335640106 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.193458:0:19769:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787432776.193466:0:19769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b3356400f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.193475:0:19769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851c00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432776.193479:0:19769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b3356400f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.193489:0:19769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b3356400f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.193506:0:19769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b3356400f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.193521:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e33c569b/0xca72b3b3356400f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.193543:0:19769:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787432776.193547:0:19769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000205803ae/0xca72b3b3356400ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.193553:0:19769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850800 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432776.193556:0:19769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000205803ae/0xca72b3b3356400ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.193564:0:19769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000205803ae/0xca72b3b3356400ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.193575:0:19769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000205803ae/0xca72b3b3356400ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.193582:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000205803ae/0xca72b3b3356400ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.193592:0:19769:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432776.193595:0:19769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b335640106 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.193601:0:19769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432776.193610:0:19769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b335640106 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.193618:0:19769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b335640106 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.193629:0:19769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b335640106 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.193636:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432776.193638:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432776.193640:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432776.193703:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787432776.193708:0:18660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cd5aa3d/0xca72b3b335640106 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787432776.194129:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432776.194136:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f17b66e2/0xca72b3b33564010d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.194151:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1787432776.194154:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432776.194159:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f17b66e2/0xca72b3b33564010d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.194188:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f17b66e2/0xca72b3b33564010d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.194197:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f17b66e2/0xca72b3b33564010d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.194204:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f17b66e2/0xca72b3b33564010d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.194219:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787432776.194487:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432776.194493:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b335640114 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.194501:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1787432776.194504:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432776.194508:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b335640114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.194518:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b335640114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.194536:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b335640114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.194543:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b335640114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.194552:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787432776.194833:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432776.194839:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002488f62c/0xca72b3b33564011b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.194847:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1787432776.194850:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432776.194854:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002488f62c/0xca72b3b33564011b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.194863:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002488f62c/0xca72b3b33564011b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.194870:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002488f62c/0xca72b3b33564011b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.194876:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002488f62c/0xca72b3b33564011b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.194895:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787432776.195199:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432776.195205:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000222f18a4/0xca72b3b335640122 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.195214:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1787432776.195217:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432776.195221:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000222f18a4/0xca72b3b335640122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.195230:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000222f18a4/0xca72b3b335640122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.195238:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000222f18a4/0xca72b3b335640122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.195245:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000222f18a4/0xca72b3b335640122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.195253:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787432776.195484:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432776.195490:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed0e823f/0xca72b3b335640129 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.195498:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1787432776.195506:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432776.195511:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed0e823f/0xca72b3b335640129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.195520:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed0e823f/0xca72b3b335640129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.195528:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed0e823f/0xca72b3b335640129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.195535:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed0e823f/0xca72b3b335640129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.195543:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787432776.195770:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432776.195776:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b6fe8f4/0xca72b3b335640130 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.195785:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1787432776.195788:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432776.195890:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787432776.195897:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f17b66e2/0xca72b3b33564010d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.195905:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432776.195910:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f17b66e2/0xca72b3b33564010d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.195919:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f17b66e2/0xca72b3b33564010d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.195937:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f17b66e2/0xca72b3b33564010d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.195946:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f17b66e2/0xca72b3b33564010d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.195964:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787432776.195968:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b335640114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.195974:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851a00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432776.195982:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b335640114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.195991:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b335640114 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.196001:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b335640114 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.196009:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029d593d3/0xca72b3b335640114 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.196022:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787432776.196025:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002488f62c/0xca72b3b33564011b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.196030:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850600 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432776.196034:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002488f62c/0xca72b3b33564011b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.196041:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002488f62c/0xca72b3b33564011b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.196051:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002488f62c/0xca72b3b33564011b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.196058:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002488f62c/0xca72b3b33564011b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.196075:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787432776.196078:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000222f18a4/0xca72b3b335640122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.196084:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851600 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432776.196088:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000222f18a4/0xca72b3b335640122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.196096:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000222f18a4/0xca72b3b335640122 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.196119:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000222f18a4/0xca72b3b335640122 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.196127:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000222f18a4/0xca72b3b335640122 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.196138:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432776.196142:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed0e823f/0xca72b3b335640129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.196148:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303851200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432776.196152:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed0e823f/0xca72b3b335640129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.196185:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed0e823f/0xca72b3b335640129 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.196195:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed0e823f/0xca72b3b335640129 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.196202:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed0e823f/0xca72b3b335640129 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.196216:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432776.196218:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432776.196220:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432776.196350:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b6fe8f4/0xca72b3b335640130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.196363:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b6fe8f4/0xca72b3b335640130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.196373:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b6fe8f4/0xca72b3b335640130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.196385:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b6fe8f4/0xca72b3b335640130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.196400:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:3.0:1787432776.196776:0:19475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1787432776.196790:0:19475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00002000:00010000:1.0:1787432776.196904:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432776.196910:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b6056d7/0xca72b3b335640137 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.196922:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1787432776.196925:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432776.196930:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b6056d7/0xca72b3b335640137 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.196939:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b6056d7/0xca72b3b335640137 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.196947:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b6056d7/0xca72b3b335640137 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.196955:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b6056d7/0xca72b3b335640137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.196963:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000001:00100000:3.0:1787432776.197188:0:19475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787432776.197229:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787432776.197235:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b6fe8f4/0xca72b3b335640130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.197244:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850a00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432776.197248:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b6fe8f4/0xca72b3b335640130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.197256:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b6fe8f4/0xca72b3b335640130 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.197281:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b6fe8f4/0xca72b3b335640130 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.197288:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b6fe8f4/0xca72b3b335640130 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.197304:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432776.197308:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b6056d7/0xca72b3b335640137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.197314:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432776.197318:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b6056d7/0xca72b3b335640137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.197325:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b6056d7/0xca72b3b335640137 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.197334:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b6056d7/0xca72b3b335640137 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.197339:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b6056d7/0xca72b3b335640137 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432776.197349:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432776.197351:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432776.197358:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432776.197490:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17898:x1874258609511680:12345-0@lo:5:osp-pre-1-1.0 Request processed in 39051us (39108us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787432776.197500:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787432776.197555:0:17898:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787432776.197563:0:17898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17898:1874258609511680:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787432776.197578:0:17898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1787432776.197627:0:17898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17898:1874258609511808:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1787432776.197662:0:17898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432776.197685:0:17898:0:(client.c:2715:ptlrpc_set_wait()) set ffff948406785c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432776.197706:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609511808 00000100:00100000:3.0:1787432776.197712:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609511808 00000100:00100000:3.0:1787432776.197753:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787432776.197762:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17898:x1874258609511808:12345-0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1787432776.198158:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432776.198180:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a45ba08/0xca72b3b33564013e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.198200:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1787432776.198203:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432776.198209:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a45ba08/0xca72b3b33564013e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.198221:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a45ba08/0xca72b3b33564013e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.198230:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a45ba08/0xca72b3b33564013e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.198239:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a45ba08/0xca72b3b33564013e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.198256:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432776.198267:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432776.198272:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a45ba08/0xca72b3b33564013e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.198279:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432776.198283:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a45ba08/0xca72b3b33564013e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.198291:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a45ba08/0xca72b3b33564013e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.198314:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a45ba08/0xca72b3b33564013e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.198322:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a45ba08/0xca72b3b33564013e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.198336:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432776.198338:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432776.198340:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432776.198680:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432776.198688:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787432776.198894:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432776.198900:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3609b3e/0xca72b3b335640145 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.198909:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1787432776.198912:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432776.198917:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3609b3e/0xca72b3b335640145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.198926:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3609b3e/0xca72b3b335640145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.198935:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3609b3e/0xca72b3b335640145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.198942:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3609b3e/0xca72b3b335640145 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432776.199055:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17898:x1874258609511808:12345-0@lo:900:osp-pre-1-1.0 Request processed in 1290us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432776.199064:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787432776.199127:0:17898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948409d24700 x1874258609511808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787432792 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432776.199141:0:17898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17898:1874258609511808:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1787432776.199220:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787432776.199523:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432776.199529:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e8ca33a/0xca72b3b33564014c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.199538:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1787432776.199541:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432776.199546:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e8ca33a/0xca72b3b33564014c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.199555:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e8ca33a/0xca72b3b33564014c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.199564:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e8ca33a/0xca72b3b33564014c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.199570:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e8ca33a/0xca72b3b33564014c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.199622:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787432776.199629:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3609b3e/0xca72b3b335640145 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.199636:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432776.199640:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3609b3e/0xca72b3b335640145 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.199648:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3609b3e/0xca72b3b335640145 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.199662:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3609b3e/0xca72b3b335640145 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.199683:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3609b3e/0xca72b3b335640145 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.199701:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432776.199705:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e8ca33a/0xca72b3b33564014c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.199712:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0a00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432776.199714:0:17142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e8ca33a/0xca72b3b33564014c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.199722:0:17142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e8ca33a/0xca72b3b33564014c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.199732:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e8ca33a/0xca72b3b33564014c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.199739:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432776.199741:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432776.199743:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432776.199810:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787432776.199816:0:18660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e8ca33a/0xca72b3b33564014c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787432776.200127:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432776.200134:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b09f3592/0xca72b3b335640153 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.200148:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1787432776.200151:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432776.200156:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b09f3592/0xca72b3b335640153 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.200195:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b09f3592/0xca72b3b335640153 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.200205:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b09f3592/0xca72b3b335640153 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.200212:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b09f3592/0xca72b3b335640153 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.200378:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432776.200383:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b09f3592/0xca72b3b335640153 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.200391:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0800 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432776.200400:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b09f3592/0xca72b3b335640153 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.200409:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b09f3592/0xca72b3b335640153 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.200421:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b09f3592/0xca72b3b335640153 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.200429:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432776.200431:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432776.200433:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432776.200491:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787432776.200497:0:18660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b09f3592/0xca72b3b335640153 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787432776.200927:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432776.200933:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33564015a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.200941:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1787432776.200946:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432776.200950:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33564015a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.200971:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33564015a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.200979:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33564015a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.200986:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33564015a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.201016:0:19769:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432776.201021:0:19769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33564015a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.201027:0:19769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0e00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432776.201030:0:19769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33564015a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.201037:0:19769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33564015a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.201047:0:19769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33564015a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.201054:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432776.201061:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432776.201063:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432776.201116:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787432776.201121:0:18660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081e8702b/0xca72b3b33564015a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787432776.201478:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432776.201483:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef755bd3/0xca72b3b335640161 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.201491:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1787432776.201494:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432776.201498:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef755bd3/0xca72b3b335640161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.201507:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef755bd3/0xca72b3b335640161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.201527:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef755bd3/0xca72b3b335640161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.201533:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef755bd3/0xca72b3b335640161 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.201545:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787432776.204330:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432776.204344:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008de4cfcc/0xca72b3b335640168 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.204362:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1787432776.204366:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432776.204374:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008de4cfcc/0xca72b3b335640168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.204388:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008de4cfcc/0xca72b3b335640168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.204399:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008de4cfcc/0xca72b3b335640168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.204407:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008de4cfcc/0xca72b3b335640168 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.204437:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787432776.205357:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787432776.205365:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b33564016f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.205378:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1787432776.205382:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432776.205387:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b33564016f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.205398:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b33564016f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.205407:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b33564016f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.205415:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b33564016f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.205424:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787432776.206548:0:19769:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787432776.206559:0:19769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef755bd3/0xca72b3b335640161 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.206570:0:19769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f0c00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432776.206575:0:19769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef755bd3/0xca72b3b335640161 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.206585:0:19769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef755bd3/0xca72b3b335640161 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.206605:0:19769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef755bd3/0xca72b3b335640161 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.206613:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef755bd3/0xca72b3b335640161 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.206636:0:19769:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787432776.206641:0:19769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008de4cfcc/0xca72b3b335640168 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.206647:0:19769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302691a00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432776.206651:0:19769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008de4cfcc/0xca72b3b335640168 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.206672:0:19769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008de4cfcc/0xca72b3b335640168 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.206683:0:19769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008de4cfcc/0xca72b3b335640168 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.206691:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008de4cfcc/0xca72b3b335640168 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.206704:0:19769:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432776.206708:0:19769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b33564016f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.206714:0:19769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302690c00 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432776.206718:0:19769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b33564016f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.206726:0:19769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b33564016f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.206735:0:19769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b33564016f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.206743:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000ef2992/0xca72b3b33564016f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.206765:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432776.206767:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432776.206769:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432776.206779:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432776.206785:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787432776.208570:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787432776.208586:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086521bf0/0xca72b3b335640176 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.208605:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=587s v=(0 0) 00010000:00010000:0.0:1787432776.208610:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432776.208619:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086521bf0/0xca72b3b335640176 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.208633:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086521bf0/0xca72b3b335640176 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.208645:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086521bf0/0xca72b3b335640176 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.208652:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086521bf0/0xca72b3b335640176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432776.208677:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787432776.208761:0:18660:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1787432776.209058:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17181:x1874258609511168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 64777us (65097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432776.209074:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787432776.209138:0:17181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304460e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17181:1874258609511168:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787432776.209155:0:17181:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00010000:00010000:1.0:1787432776.209201:0:19769:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432776.209209:0:19769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086521bf0/0xca72b3b335640176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.209218:0:19769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488800 already unused, calling callback (ffffffffc0c32230) 00000100:00100000:2.0:1787432776.209221:0:17181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304460e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17181:1874258609511936:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1787432776.209227:0:19769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086521bf0/0xca72b3b335640176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.209237:0:19769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086521bf0/0xca72b3b335640176 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.209256:0:19769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086521bf0/0xca72b3b335640176 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432776.209259:0:17181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787432776.209264:0:19769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086521bf0/0xca72b3b335640176 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432776.209281:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432776.209284:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432776.209285:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432776.209288:0:17181:0:(client.c:2715:ptlrpc_set_wait()) set ffff948302773240 going to sleep for 11 seconds 00000100:00100000:0.0:1787432776.209409:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609511936 00000100:00100000:0.0:1787432776.209418:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609511936 00000100:00100000:0.0:1787432776.209462:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787432776.209471:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17181:x1874258609511936:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787432776.209510:0:18659:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:0.0:1787432776.215148:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17181:x1874258609511936:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5672us (5882us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787432776.215161:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787432776.215660:0:17181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304460e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17181:1874258609511936:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787432776.215678:0:17181:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:0.0:1787432776.844654:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432777.172926:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432777.172950:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609512064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432777.173028:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432777.173075:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609512064 00000100:00100000:2.0:1787432777.173090:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609512064 00000100:00100000:2.0:1787432777.173143:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787432777.173154:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609512064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432777.173207:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787432777.173265:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609512064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432777.173272:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787432777.173332:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609512064:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787432777.240031:0:19832:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg424-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787432777.868262:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432778.189117:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609512192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787432778.189537:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432778.189611:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609512192 00000100:00100000:0.0:1787432778.189619:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609512192 00000100:00100000:0.0:1787432778.189667:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787432778.189677:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609512192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787432778.189709:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787432778.189902:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609512192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 225us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432778.189911:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787432778.189970:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609512192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787432778.189993:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609512320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432778.190032:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432778.190085:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432778.190092:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609512448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787432778.190118:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432778.190150:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609512448 00000100:00100000:1.0:1787432778.190154:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609512448 00000100:00100000:0.0:1787432778.191669:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609512320 00000100:00100000:0.0:1787432778.191679:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609512320 00000100:00100000:0.0:1787432778.191731:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787432778.191739:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609512320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432778.191781:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787432778.191844:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609512320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432778.191851:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1787432778.191873:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432778.191906:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609512320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432778.195193:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787432778.195445:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609512448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787432778.195474:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787432778.195559:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609512448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (5439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432778.195581:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787432778.195953:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609512448:0@lo:13:osp-pre-0-1.0 00000020:00000004:2.0:1787432778.393818:0:19884:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787432778.394020:0:19884:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787432778.894116:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787432779.348754:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1787432779.457706:0:19934:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787432779.457956:0:19934:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787432779.850730:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432779.850805:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588455808 00000100:00100000:0.0:1787432779.850816:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588455808 00000100:00100000:0.0:1787432779.850871:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 116 00000100:00100000:0.0:1787432779.850880:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403063850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2399:x1874258588455808:12345-192.168.204.24@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787432779.850911:0:17148:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 15916cf8-04d2-4c09-9229-fbbbb74d56ef@192.168.204.24@tcp t0 exp 0000000000000000 cur 590 last 0 00000020:00000080:0.0:1787432779.850943:0:17148:0:(genops.c:1385:class_connect()) connect: client 15916cf8-04d2-4c09-9229-fbbbb74d56ef, cookie 0xca72b3b33564017d 00000100:00080000:0.0:1787432779.851094:0:17148:0:(import.c:65:import_set_state_nolock()) ffff948301e45800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432779.851229:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403063850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+5:2399:x1874258588455808:12345-192.168.204.24@tcp:250:mount.lustre.0 Request processed in 347us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432779.851241:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 116 00000100:00100000:0.0:1787432779.875917:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432779.876663:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588455936 00000100:00100000:2.0:1787432779.876675:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588455936 00000100:00100000:0.0:1787432779.876843:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 117 00000100:00100000:0.0:1787432779.876854:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+5:14937:x1874258588455936:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787432779.876870:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432779.876887:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948304489a00/0xca72b3b335640184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d512e expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432779.876944:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948304489a00/0xca72b3b335640184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d512e expref: 6 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432779.876956:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948304489a00/0xca72b3b335640184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d512e expref: 6 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432779.876965:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304489a00, rc 0) 00000100:00100000:0.0:1787432779.877025:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+6:14937:x1874258588455936:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 173us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432779.877042:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 117 00000100:00100000:3.0:1787432779.879665:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432779.880048:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588456064 00000100:00100000:2.0:1787432779.880059:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588456064 00000100:00100000:2.0:1787432779.880120:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 118 00000100:00100000:2.0:1787432779.880131:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+6:14937:x1874258588456064:12345-192.168.204.24@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787432779.880299:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+6:14937:x1874258588456064:12345-192.168.204.24@tcp:501:mount.lustre.0 Request processed in 170us (643us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787432779.880307:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 118 00000100:00100000:2.0:1787432779.885095:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432779.885549:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588456192 00000100:00100000:3.0:1787432779.885558:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588456192 00000100:00100000:3.0:1787432779.885624:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 119 00000100:00100000:3.0:1787432779.885635:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948403061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+6:14937:x1874258588456192:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787432779.885651:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432779.888725:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94843f85f200/0xca72b3b33564018b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5135 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432779.888791:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94843f85f200/0xca72b3b33564018b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5135 expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432779.888806:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94843f85f200/0xca72b3b33564018b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5135 expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432779.888819:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85f200, rc 0) 00000100:00100000:3.0:1787432779.888902:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948403061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+7:14937:x1874258588456192:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 3267us (3890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432779.888911:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 119 00000100:00100000:3.0:1787432779.893899:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432779.894066:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588456320 00000100:00100000:0.0:1787432779.894080:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588456320 00000100:00100000:0.0:1787432779.894149:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 120 00000100:00100000:0.0:1787432779.894160:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948420e41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+7:14937:x1874258588456320:12345-192.168.204.24@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787432779.898861:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948420e41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+8:14937:x1874258588456320:12345-192.168.204.24@tcp:501:mount.lustre.0 Request processed in 4692us (4963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432779.898888:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 120 00000100:00100000:0.0:1787432779.903322:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432779.903660:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588456448 00000100:00100000:3.0:1787432779.903670:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588456448 00000100:00100000:3.0:1787432779.903740:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 121 00000100:00100000:3.0:1787432779.903752:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+8:14937:x1874258588456448:12345-192.168.204.24@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787432779.903944:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+8:14937:x1874258588456448:12345-192.168.204.24@tcp:503:mount.lustre.0 Request processed in 194us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432779.903953:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 121 00000100:00100000:2.0:1787432779.908695:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432779.908818:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588456576 00000100:00100000:1.0:1787432779.908829:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588456576 00000100:00100000:1.0:1787432779.908897:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 122 00000100:00100000:1.0:1787432779.908910:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+8:14956:x1874258588456576:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787432779.909088:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+8:14956:x1874258588456576:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 180us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432779.909096:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 122 00010000:00010000:0.0:1787432779.915339:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432779.959533:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432779.959637:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588456704 00000100:00100000:3.0:1787432779.959649:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588456704 00000100:00100000:3.0:1787432779.959717:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 123 00000100:00100000:3.0:1787432779.959737:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+8:14956:x1874258588456704:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787432779.959905:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+8:14956:x1874258588456704:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 177us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432779.959913:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 123 00000100:00100000:3.0:1787432779.965964:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432779.969003:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588456832 00000100:00100000:0.0:1787432779.969020:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588456832 00000100:00100000:0.0:1787432779.969120:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 124 00000100:00100000:0.0:1787432779.969131:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+8:14956:x1874258588456832:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787432779.969347:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+8:14956:x1874258588456832:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 217us (3392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432779.969355:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 124 00000100:00100000:2.0:1787432779.976826:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432779.977355:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588456960 00000100:00100000:3.0:1787432779.977366:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588456960 00000100:00100000:3.0:1787432779.977427:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 125 00000100:00100000:3.0:1787432779.977438:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+8:14937:x1874258588456960:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787432779.977454:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432779.977472:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94843f85fa00/0xca72b3b335640192 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5166 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432779.977500:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94843f85fa00/0xca72b3b335640192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5166 expref: 9 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432779.977510:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94843f85fa00/0xca72b3b335640192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5166 expref: 9 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432779.977518:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85fa00, rc 0) 00000100:00100000:3.0:1787432779.977643:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+9:14937:x1874258588456960:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 206us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432779.977650:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 125 00000100:00100000:2.0:1787432779.995640:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432779.995845:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588457088 00000100:00100000:1.0:1787432779.995855:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588457088 00000100:00100000:1.0:1787432779.995953:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 126 00000100:00100000:1.0:1787432779.995965:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+9:14937:x1874258588457088:12345-192.168.204.24@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787432779.995992:0:17149:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787432779.996011:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787432779.996016:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787432779.996019:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787432779.996079:0:17149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787432779.996082:0:17149:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1787432779.999496:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+9:14937:x1874258588457088:12345-192.168.204.24@tcp:256:mount.lustre.0 Request processed in 3522us (3854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432779.999510:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 126 00000100:00100000:3.0:1787432780.002292:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432780.002468:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588457216 00000100:00100000:0.0:1787432780.002478:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588457216 00000100:00100000:0.0:1787432780.002547:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 127 00000100:00100000:0.0:1787432780.002558:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+9:14937:x1874258588457216:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787432780.002575:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432780.002592:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948304489000/0xca72b3b335640199 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d516d expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.002621:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948304489000/0xca72b3b335640199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d516d expref: 10 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.002632:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948304489000/0xca72b3b335640199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d516d expref: 10 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.002642:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304489000, rc 0) 00000100:00100000:0.0:1787432780.002753:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+10:14937:x1874258588457216:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 197us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432780.002761:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 127 00000100:00100000:2.0:1787432780.005061:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432780.005144:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588457344 00000100:00100000:1.0:1787432780.005152:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588457344 00000100:00100000:1.0:1787432780.005334:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 128 00000100:00100000:1.0:1787432780.005345:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+10:14937:x1874258588457344:12345-192.168.204.24@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787432780.005492:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+10:14937:x1874258588457344:12345-192.168.204.24@tcp:501:mount.lustre.0 Request processed in 148us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432780.005500:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 128 00000100:00100000:1.0:1787432780.017951:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432780.018087:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588457472 00000100:00100000:2.0:1787432780.018098:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588457472 00000100:00100000:2.0:1787432780.018185:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 129 00000100:00100000:2.0:1787432780.018198:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+10:14937:x1874258588457472:12345-192.168.204.24@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787432780.018371:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+10:14937:x1874258588457472:12345-192.168.204.24@tcp:503:mount.lustre.0 Request processed in 175us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432780.018380:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 129 00000100:00100000:2.0:1787432780.025294:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432780.025420:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588457600 00000100:00100000:1.0:1787432780.025433:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588457600 00000100:00100000:1.0:1787432780.025635:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 130 00000100:00100000:1.0:1787432780.025648:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+10:14962:x1874258588457600:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787432780.026871:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+10:14962:x1874258588457600:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 1211us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432780.026890:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 130 00000100:00100000:3.0:1787432780.030121:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432780.030819:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588457728 00000100:00100000:0.0:1787432780.030832:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588457728 00000100:00100000:0.0:1787432780.030902:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 131 00000100:00100000:0.0:1787432780.030913:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+10:14962:x1874258588457728:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787432780.032543:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+10:14962:x1874258588457728:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 1624us (2427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432780.032557:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 131 00000100:00100000:2.0:1787432780.041148:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432780.041685:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432780.042436:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588457856 00000100:00100000:0.0:1787432780.042457:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588457856 00000100:00100000:0.0:1787432780.042509:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588458112 00000100:00100000:0.0:1787432780.042513:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588458112 00000100:00100000:0.0:1787432780.042530:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:0.0:1787432780.042552:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1874258588457856:12345-192.168.204.24@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787432780.042587:0:17154:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 17ee1936-2707-48b4-a113-f80e95ac94b4@192.168.204.24@tcp t0 exp 0000000000000000 cur 591 last 0 00000020:00000080:0.0:1787432780.042640:0:17154:0:(genops.c:1385:class_connect()) connect: client 17ee1936-2707-48b4-a113-f80e95ac94b4, cookie 0xca72b3b3356401a0 00000004:00100000:0.0:1787432780.042681:0:17154:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787432780.043101:0:17154:0:(import.c:65:import_set_state_nolock()) ffff94842d4c1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432780.043222:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+6:2399:x1874258588457856:12345-192.168.204.24@tcp:38:mount.lustre.0 Request processed in 671us (2083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432780.043232:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:0.0:1787432780.043254:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:0.0:1787432780.043259:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1874258588458112:12345-192.168.204.24@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787432780.043287:0:17154:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 17ee1936-2707-48b4-a113-f80e95ac94b4@192.168.204.24@tcp t0 exp 0000000000000000 cur 591 last 0 00000020:00000080:0.0:1787432780.043317:0:17154:0:(genops.c:1385:class_connect()) connect: client 17ee1936-2707-48b4-a113-f80e95ac94b4, cookie 0xca72b3b3356401a7 00000004:00100000:0.0:1787432780.043331:0:17154:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787432780.043479:0:17154:0:(import.c:65:import_set_state_nolock()) ffff94842d4c3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432780.043506:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+6:2399:x1874258588458112:12345-192.168.204.24@tcp:38:mount.lustre.0 Request processed in 245us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432780.043513:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:1.0:1787432780.048469:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432780.048507:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432780.048618:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432780.048838:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588458240 00000100:00100000:2.0:1787432780.048848:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588458240 00000100:00100000:2.0:1787432780.048908:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588457984 00000100:00100000:2.0:1787432780.048912:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588457984 00000100:00100000:2.0:1787432780.048924:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588458368 00000100:00100000:2.0:1787432780.048927:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588458368 00000100:00100000:2.0:1787432780.048941:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:2.0:1787432780.048951:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+6:0:x1874258588458240:12345-192.168.204.24@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787432780.048988:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:1.0:1787432780.049091:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432780.049095:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787432780.049204:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+6:0:x1874258588458240:12345-192.168.204.24@tcp:41:mount.lustre.0 Request processed in 253us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432780.049212:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:2.0:1787432780.049230:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 10 00000100:00100000:2.0:1787432780.049251:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+7:0:x1874258588457984:12345-192.168.204.24@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787432780.049279:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787432780.049316:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+7:0:x1874258588457984:12345-192.168.204.24@tcp:41:mount.lustre.0 Request processed in 67us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432780.049322:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 10 00000100:00100000:2.0:1787432780.049335:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 11 00000100:00100000:2.0:1787432780.049342:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+6:14937:x1874258588458368:12345-192.168.204.24@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787432780.049352:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787432780.049371:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+6:14937:x1874258588458368:12345-192.168.204.24@tcp:41:mount.lustre.0 Request processed in 30us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432780.049377:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 11 00000100:00100000:2.0:1787432780.052322:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432780.052445:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588458496 00000100:00100000:0.0:1787432780.052454:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588458496 00000100:00100000:0.0:1787432780.052552:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:0.0:1787432780.052562:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+6:14937:x1874258588458496:12345-192.168.204.24@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787432780.052688:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+6:14937:x1874258588458496:12345-192.168.204.24@tcp:40:mount.lustre.0 Request processed in 127us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432780.052696:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:1.0:1787432780.054330:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432780.054363:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432780.054395:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432780.054490:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588458880 00000100:00100000:2.0:1787432780.054499:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588458880 00000100:00100000:2.0:1787432780.054543:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:2.0:1787432780.054552:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:17ee1936-2707-48b4-a113-f80e95ac94b4+6:14937:x1874258588458880:12345-192.168.204.24@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787432780.054627:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:17ee1936-2707-48b4-a113-f80e95ac94b4+6:14937:x1874258588458880:12345-192.168.204.24@tcp:900:mount.lustre.0 Request processed in 76us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432780.054636:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:0.0:1787432780.055034:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588458624 00000100:00100000:0.0:1787432780.055039:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588458624 00000100:00100000:0.0:1787432780.055067:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588458752 00000100:00100000:0.0:1787432780.055070:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588458752 00000100:00100000:0.0:1787432780.055093:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 19 00000100:00100000:0.0:1787432780.055099:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1874258588458624:12345-192.168.204.24@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787432780.055125:0:18660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 17ee1936-2707-48b4-a113-f80e95ac94b4@192.168.204.24@tcp t0 exp 0000000000000000 cur 591 last 0 00000020:00000080:0.0:1787432780.055153:0:18660:0:(genops.c:1385:class_connect()) connect: client 17ee1936-2707-48b4-a113-f80e95ac94b4, cookie 0xca72b3b3356401ae 00002000:00100000:0.0:1787432780.055184:0:18660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 17ee1936-2707-48b4-a113-f80e95ac94b4/ffff94842d4c0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787432780.055201:0:18660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787432780.055393:0:18660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787432780.055418:0:18660:0:(import.c:65:import_set_state_nolock()) ffff94842d4c4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432780.055457:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+6:2399:x1874258588458624:12345-192.168.204.24@tcp:8:mount.lustre.0 Request processed in 357us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432780.055465:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 19 00000100:00100000:0.0:1787432780.055480:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00100000:0.0:1787432780.055485:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830379b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1874258588458752:12345-192.168.204.24@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787432780.055501:0:18660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 17ee1936-2707-48b4-a113-f80e95ac94b4@192.168.204.24@tcp t0 exp 0000000000000000 cur 591 last 0 00000020:00000080:0.0:1787432780.055516:0:18660:0:(genops.c:1385:class_connect()) connect: client 17ee1936-2707-48b4-a113-f80e95ac94b4, cookie 0xca72b3b3356401b5 00002000:00100000:0.0:1787432780.055521:0:18660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 17ee1936-2707-48b4-a113-f80e95ac94b4/ffff94842d4c2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787432780.055532:0:18660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787432780.056384:0:18660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787432780.056410:0:18660:0:(import.c:65:import_set_state_nolock()) ffff94842d4c2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432780.056499:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830379b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+6:2399:x1874258588458752:12345-192.168.204.24@tcp:8:mount.lustre.0 Request processed in 1012us (2134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432780.056519:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00100000:2.0:1787432780.060114:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432780.060237:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588459008 00000100:00100000:1.0:1787432780.060247:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588459008 00000100:00100000:1.0:1787432780.060406:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:1.0:1787432780.060418:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+6:14937:x1874258588459008:12345-192.168.204.24@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787432780.072364:0:17157:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 11855us 00000004:00200000:2.0:1787432780.094451:0:17157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787432780.094570:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+6:14937:x1874258588459008:12345-192.168.204.24@tcp:33:mount.lustre.0 Request processed in 34150us (34464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432780.094594:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:1.0:1787432780.302048:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432780.305617:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588459136 00000100:00100000:3.0:1787432780.305633:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588459136 00000100:00100000:3.0:1787432780.305771:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 13 00000100:00100000:3.0:1787432780.305786:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+6:14985:x1874258588459136:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:3.0:1787432780.305807:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432780.305838:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b3356401bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d519e expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432780.305905:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356401c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432780.305920:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356401c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432780.305935:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356401c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432780.305986:0:17156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787432780.305990:0:17156:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787432780.306034:0:17156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356401c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432780.306060:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b3356401bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d519e expref: 8 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432780.306102:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356401c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d519e expref: 7 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432780.306110:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9483026f7400) 00010000:00010000:3.0:1787432780.306113:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432780.306116:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85ee00, rc 0) 00000100:00100000:3.0:1787432780.306214:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+7:14985:x1874258588459136:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 431us (4176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432780.306221:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 13 00010000:00010000:0.0:1787432780.939391:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432781.259623:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609512832:0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.259719:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432781.259733:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609512576:0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.259791:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609513344:0@lo:400:kworker.0 00000100:00100000:0.0:1787432781.259804:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432781.259905:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609512960:0@lo:400:kworker.0 00000100:00100000:2.0:1787432781.259910:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609512832 00000100:00100000:2.0:1787432781.259920:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609512832 00000100:00100000:2.0:1787432781.259979:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787432781.259989:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609512832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.261503:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432781.261556:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609513856:0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.261600:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432781.261632:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609514368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432781.261658:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432781.262156:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609513856 00000100:00100000:3.0:1787432781.262185:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609513856 00000100:00100000:3.0:1787432781.262245:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787432781.262257:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609513856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.262312:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609513856:12345-0@lo:400:kworker.0 Request processed in 59us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432781.262319:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787432781.262359:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609514368 00000100:00100000:3.0:1787432781.262363:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609514368 00000100:00100000:3.0:1787432781.262394:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787432781.262401:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609514368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787432781.262417:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787432781.263404:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609514368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 998us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432781.263415:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787432781.263451:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432781.263468:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432781.263520:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609514368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432781.263536:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609513856:0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.263593:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609513344 00000100:00100000:3.0:1787432781.263598:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609513344 00000100:00100000:3.0:1787432781.263625:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787432781.263633:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609513344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.263691:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609513344:12345-0@lo:400:kworker.0 Request processed in 58us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432781.263697:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787432781.263820:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609512704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432781.263855:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432781.263878:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609513216:0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.263900:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432781.263919:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609513728:0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.263937:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432781.263969:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609514240:0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.263991:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432781.264034:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609512704 00000100:00100000:3.0:1787432781.264038:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609512704 00000100:00100000:3.0:1787432781.264068:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787432781.264075:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609512704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787432781.264088:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787432781.264123:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609512704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432781.264129:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787432781.264148:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609513216 00000100:00100000:3.0:1787432781.264151:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609513216 00000100:00100000:3.0:1787432781.264196:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609513728 00000100:00100000:3.0:1787432781.264199:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609513728 00000100:00100000:3.0:1787432781.264211:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609514240 00000100:00100000:3.0:1787432781.264214:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609514240 00000100:00100000:3.0:1787432781.264228:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787432781.264235:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609513216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.264265:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609513216:12345-0@lo:400:kworker.0 Request processed in 31us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432781.264271:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787432781.264283:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787432781.264289:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609513728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.264316:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609513728:12345-0@lo:400:kworker.0 Request processed in 28us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432781.264322:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787432781.264335:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787432781.264341:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609514240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.264377:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609514240:12345-0@lo:400:kworker.0 Request processed in 36us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432781.264383:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1787432781.264399:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432781.264403:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432781.264431:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609512704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432781.264442:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609513216:0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.264450:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609513728:0@lo:400:kworker.0 00010000:00080000:3.0:1787432781.264461:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435b64000 x1874258609514240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432781.264471:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609514240:0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.264505:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609513344:0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.264543:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609512576 00000100:00100000:3.0:1787432781.264547:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609512576 00000100:00100000:3.0:1787432781.264574:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787432781.264581:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948418e9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3643:x1874258609512576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.264612:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948418e9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3643:x1874258609512576:12345-0@lo:400:kworker.0 Request processed in 32us (4810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432781.264618:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787432781.270177:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609512576:0@lo:400:kworker.0 00000100:00100000:0.0:1787432781.270196:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609513088:0@lo:400:kworker.0 00000100:00100000:0.0:1787432781.271561:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432781.271604:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609513600:0@lo:400:kworker.0 00000100:00100000:0.0:1787432781.271657:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432781.271701:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609513088 00000100:00100000:0.0:1787432781.271708:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609513088 00000100:00100000:0.0:1787432781.271761:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609513600 00000100:00100000:0.0:1787432781.271764:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609513600 00000100:00100000:0.0:1787432781.271782:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432781.272018:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609512832:12345-0@lo:400:kworker.0 Request processed in 12011us (12289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432781.272029:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787432781.272080:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609512832:0@lo:400:kworker.0 00000100:00100000:0.0:1787432781.272154:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1874258609513088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432781.272220:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1874258609513088:12345-0@lo:400:kworker.0 Request processed in 72us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432781.276344:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787432781.276374:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609513600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.276472:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609513600:12345-0@lo:400:kworker.0 Request processed in 114us (4814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432781.276496:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787432781.276598:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609513600:0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.276609:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609514112:0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.276649:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432781.276683:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609514112 00000100:00100000:3.0:1787432781.276689:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609514112 00000100:00100000:3.0:1787432781.276753:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787432781.276761:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609514112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.276795:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874258609514112:12345-0@lo:400:kworker.0 Request processed in 35us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432781.276802:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1787432781.276819:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432781.276841:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1874258609514112:0@lo:400:kworker.0 00000100:00100000:3.0:1787432781.276883:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609513088:0@lo:400:kworker.0 00000100:00100000:1.0:1787432781.282502:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432781.282554:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609513472:0@lo:400:kworker.0 00000100:00100000:1.0:1787432781.282595:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432781.282626:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609513984:0@lo:400:kworker.0 00000100:00100000:1.0:1787432781.282670:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432781.282706:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609513984 00000100:00100000:1.0:1787432781.282713:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609513984 00000100:00100000:2.0:1787432781.282759:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609512960 00000100:00100000:2.0:1787432781.282766:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609512960 00000100:00100000:1.0:1787432781.282776:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787432781.282802:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609513984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432781.282804:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609513472 00000100:00100000:2.0:1787432781.282808:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609513472 00000100:00100000:2.0:1787432781.282829:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787432781.282838:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609512960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432781.282862:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874258609513984:12345-0@lo:400:kworker.0 Request processed in 77us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432781.282870:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787432781.282889:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609512960:12345-0@lo:400:kworker.0 Request processed in 52us (393us total) trans 0 rc 0/0 00000100:00080000:1.0:1787432781.282897:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432781.282898:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1787432781.282904:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787432781.282918:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787432781.282926:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609513472:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787432781.282939:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948435b67800 x1874258609513984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432781.282958:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609513472:12345-0@lo:400:kworker.0 Request processed in 32us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432781.282965:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432781.282968:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1874258609513984:0@lo:400:kworker.0 00000100:00100000:1.0:1787432781.283011:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609512960:0@lo:400:kworker.0 00000100:00100000:1.0:1787432781.283023:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609513472:0@lo:400:kworker.0 00000100:00100000:0.0:1787432781.288424:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000001:00100000:3.0:1787432781.777027:0:19475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 17ee1936-2707-48b4-a113-f80e95ac94b4 00000001:00080000:3.0:1787432781.777048:0:19475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:1.0:1787432781.963664:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432782.291859:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432782.291889:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609514496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432782.291963:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432782.292005:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609514496 00000100:00100000:0.0:1787432782.292014:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609514496 00000100:00100000:0.0:1787432782.292072:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787432782.292083:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609514496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432782.292111:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787432782.292207:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609514496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432782.292229:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432782.292417:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609514496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432782.489656:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432782.489913:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588459264 00000100:00100000:3.0:1787432782.489928:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588459264 00000100:00100000:3.0:1787432782.490036:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00100000:3.0:1787432782.490048:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+7:15037:x1874258588459264:12345-192.168.204.24@tcp:41:lfs.0 00000004:00000024:3.0:1787432782.490095:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787432782.490265:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+7:15037:x1874258588459264:12345-192.168.204.24@tcp:41:lfs.0 Request processed in 219us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432782.490274:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00080000:1.0:1787432782.490853:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432782.493725:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432782.493830:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588459392 00000100:00100000:1.0:1787432782.493840:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588459392 00000100:00100000:1.0:1787432782.493923:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00100000:1.0:1787432782.493934:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+6:15037:x1874258588459392:12345-192.168.204.24@tcp:41:lfs.0 00000004:00000024:1.0:1787432782.493971:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787432782.494063:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+6:15037:x1874258588459392:12345-192.168.204.24@tcp:41:lfs.0 Request processed in 131us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432782.494079:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00080000:3.0:1787432782.494207:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787432782.500575:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432782.500747:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588459520 00000100:00100000:3.0:1787432782.500761:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588459520 00000100:00100000:3.0:1787432782.500855:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00080000:1.0:1787432782.500855:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432782.500870:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:17ee1936-2707-48b4-a113-f80e95ac94b4+6:15037:x1874258588459520:12345-192.168.204.24@tcp:13:lfs.0 00002000:00000024:3.0:1787432782.500898:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787432782.501158:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:17ee1936-2707-48b4-a113-f80e95ac94b4+6:15037:x1874258588459520:12345-192.168.204.24@tcp:13:lfs.0 Request processed in 291us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432782.501270:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:2.0:1787432782.508291:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432782.508406:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588459648 00000100:00100000:3.0:1787432782.508418:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588459648 00000100:00100000:3.0:1787432782.508513:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 13 00000100:00100000:3.0:1787432782.508528:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:17ee1936-2707-48b4-a113-f80e95ac94b4+5:15037:x1874258588459648:12345-192.168.204.24@tcp:13:lfs.0 00002000:00000024:3.0:1787432782.508567:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787432782.509066:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:17ee1936-2707-48b4-a113-f80e95ac94b4+5:15037:x1874258588459648:12345-192.168.204.24@tcp:13:lfs.0 Request processed in 144us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432782.509078:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 13 00000100:00080000:1.0:1787432782.510917:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432782.784539:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432782.784655:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588459776 00000100:00100000:0.0:1787432782.784664:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588459776 00000100:00100000:0.0:1787432782.784724:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 133 00000100:00100000:0.0:1787432782.784734:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948418e9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+10:15069:x1874258588459776:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787432782.784758:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432782.784800:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948304488200/0xca72b3b3356401ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d51a5 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432782.784831:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948304488200/0xca72b3b3356401ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d51a5 expref: 11 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432782.784842:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948304488200/0xca72b3b3356401ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d51a5 expref: 11 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432782.784851:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304488200, rc 0) 00000100:00100000:0.0:1787432782.784912:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948418e9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+11:15069:x1874258588459776:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 179us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432782.784919:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 133 00000100:00100000:2.0:1787432782.789757:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432782.789909:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588459904 00000100:00100000:3.0:1787432782.789919:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588459904 00000100:00100000:3.0:1787432782.789987:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 134 00000100:00100000:3.0:1787432782.789998:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948418e9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+11:15069:x1874258588459904:12345-192.168.204.24@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787432782.790220:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948418e9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+11:15069:x1874258588459904:12345-192.168.204.24@tcp:501:mount.lustre.0 Request processed in 212us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432782.790247:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 134 00000100:00100000:2.0:1787432782.800447:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432782.800540:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588460032 00000100:00100000:3.0:1787432782.800550:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588460032 00000100:00100000:3.0:1787432782.800611:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 135 00000100:00100000:3.0:1787432782.800622:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948418e9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+11:15069:x1874258588460032:12345-192.168.204.24@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787432782.800776:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948418e9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+11:15069:x1874258588460032:12345-192.168.204.24@tcp:503:mount.lustre.0 Request processed in 155us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432782.800784:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 135 00000100:00100000:2.0:1787432782.816394:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432782.816793:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588460160 00000100:00100000:3.0:1787432782.816803:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588460160 00000100:00100000:3.0:1787432782.816866:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 136 00000100:00100000:3.0:1787432782.816877:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948418e9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+11:15075:x1874258588460160:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787432782.817200:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948418e9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+11:15075:x1874258588460160:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 324us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432782.817964:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 136 00000100:00100000:2.0:1787432782.864731:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432782.864823:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588460288 00000100:00100000:0.0:1787432782.864833:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588460288 00000100:00100000:1.0:1787432782.865024:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 137 00000100:00100000:1.0:1787432782.865037:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948418e9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+11:15075:x1874258588460288:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787432782.865246:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948418e9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+11:15075:x1874258588460288:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 212us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432782.865254:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 137 00000100:00100000:2.0:1787432782.876742:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432782.880510:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588460416 00000100:00100000:3.0:1787432782.880531:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588460416 00000100:00100000:3.0:1787432782.880675:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 138 00000100:00100000:3.0:1787432782.880687:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+11:15075:x1874258588460416:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787432782.880862:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+11:15075:x1874258588460416:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 177us (4132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432782.880871:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 138 00000100:00100000:2.0:1787432782.888216:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432782.888363:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588460544 00000100:00100000:0.0:1787432782.888373:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588460544 00000100:00100000:0.0:1787432782.888434:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 139 00000100:00100000:0.0:1787432782.888445:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+11:15069:x1874258588460544:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787432782.888461:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432782.888493:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948304488000/0xca72b3b3356401d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d51d6 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432782.888526:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948304488000/0xca72b3b3356401d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d51d6 expref: 12 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432782.888539:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948304488000/0xca72b3b3356401d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d51d6 expref: 12 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432782.888549:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304488000, rc 0) 00000100:00100000:0.0:1787432782.888613:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+12:15069:x1874258588460544:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 170us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432782.888620:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 139 00000100:00100000:2.0:1787432782.891707:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432782.892552:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588460672 00000100:00100000:3.0:1787432782.892563:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588460672 00000100:00100000:3.0:1787432782.892690:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 140 00000100:00100000:3.0:1787432782.892702:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+12:15069:x1874258588460672:12345-192.168.204.24@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787432782.892727:0:17147:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787432782.892747:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787432782.892751:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787432782.892754:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787432782.892756:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787432782.892758:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1787432782.894855:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+12:15069:x1874258588460672:12345-192.168.204.24@tcp:256:mount.lustre.0 Request processed in 2146us (3149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432782.894869:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 140 00000100:00100000:2.0:1787432782.898522:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432782.898792:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588460800 00000100:00100000:1.0:1787432782.898802:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588460800 00000100:00100000:1.0:1787432782.898908:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 141 00000100:00100000:1.0:1787432782.898920:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+12:15069:x1874258588460800:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787432782.898938:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432782.898958:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302690e00/0xca72b3b3356401d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d51dd expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.899000:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302690e00/0xca72b3b3356401d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d51dd expref: 13 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.899011:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302690e00/0xca72b3b3356401d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d51dd expref: 13 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.899389:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302690e00, rc 0) 00000100:00100000:1.0:1787432782.899442:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:15069:x1874258588460800:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 525us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432782.899450:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 141 00000100:00100000:2.0:1787432782.901282:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432782.901651:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588460928 00000100:00100000:0.0:1787432782.901661:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588460928 00000100:00100000:0.0:1787432782.901712:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 142 00000100:00100000:0.0:1787432782.901721:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:15069:x1874258588460928:12345-192.168.204.24@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787432782.901903:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:15069:x1874258588460928:12345-192.168.204.24@tcp:501:mount.lustre.0 Request processed in 182us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432782.901911:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 142 00000100:00100000:2.0:1787432782.904383:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432782.904553:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588461056 00000100:00100000:1.0:1787432782.904562:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588461056 00000100:00100000:1.0:1787432782.904616:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 143 00000100:00100000:1.0:1787432782.904626:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:15069:x1874258588461056:12345-192.168.204.24@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787432782.904776:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:15069:x1874258588461056:12345-192.168.204.24@tcp:503:mount.lustre.0 Request processed in 151us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432782.904784:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 143 00000100:00100000:2.0:1787432782.907957:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432782.908060:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588461184 00000100:00100000:1.0:1787432782.908069:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588461184 00000100:00100000:1.0:1787432782.908117:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 144 00000100:00100000:1.0:1787432782.908127:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:15079:x1874258588461184:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787432782.908306:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:15079:x1874258588461184:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 179us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432782.908314:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 144 00000100:00100000:2.0:1787432782.923263:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432782.923363:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588461312 00000100:00100000:0.0:1787432782.923376:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588461312 00000100:00100000:0.0:1787432782.923444:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 145 00000100:00100000:0.0:1787432782.923455:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:15079:x1874258588461312:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787432782.923630:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:15079:x1874258588461312:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 175us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432782.923639:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 145 00000100:00100000:2.0:1787432782.937009:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432782.937051:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432782.937087:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432782.937121:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432782.937428:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588462336 00000100:00100000:1.0:1787432782.937437:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588462336 00000100:00100000:1.0:1787432782.937480:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588462208 00000100:00100000:1.0:1787432782.937483:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588462208 00000100:00100000:1.0:1787432782.937498:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 41 00000100:00100000:1.0:1787432782.937506:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+6:2401:x1874258588462336:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432782.937575:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+6:2401:x1874258588462336:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 70us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432782.937583:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 41 00000100:00100000:1.0:1787432782.937599:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 42 00000100:00100000:1.0:1787432782.937606:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+7:2401:x1874258588462208:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432782.937653:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+7:2401:x1874258588462208:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 47us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432782.937660:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 42 00000100:00100000:2.0:1787432782.938550:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432782.938867:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588462592 00000100:00100000:1.0:1787432782.938874:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588462592 00000100:00100000:1.0:1787432782.938910:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588462464 00000100:00100000:1.0:1787432782.938913:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588462464 00000100:00100000:1.0:1787432782.938930:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:1.0:1787432782.938938:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2401:x1874258588462592:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432782.938993:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2401:x1874258588462592:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 55us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432782.939000:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:1.0:1787432782.939014:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 10 00000100:00100000:1.0:1787432782.939102:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+6:2401:x1874258588462464:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432782.939131:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+6:2401:x1874258588462464:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 110us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432782.939138:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 10 00000100:00100000:3.0:1787432782.943863:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588462080 00000100:00100000:3.0:1787432782.943878:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588462080 00000100:00100000:3.0:1787432782.943943:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 146 00000100:00100000:3.0:1787432782.943955:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:2401:x1874258588462080:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432782.953116:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:2401:x1874258588462080:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 9148us (16102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432782.953133:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 146 00000100:00100000:2.0:1787432782.958861:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432782.959079:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432782.959979:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588461440 00000100:00100000:3.0:1787432782.959991:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588461440 00000100:00100000:3.0:1787432782.960048:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588461696 00000100:00100000:3.0:1787432782.960052:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588461696 00000100:00100000:3.0:1787432782.960068:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:3.0:1787432782.960077:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1874258588461440:12345-192.168.204.24@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787432782.960105:0:17154:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9fd65f33-d046-43bb-9119-74a1dce1ebb4@192.168.204.24@tcp t0 exp 0000000000000000 cur 594 last 0 00000020:00000080:3.0:1787432782.960143:0:17154:0:(genops.c:1385:class_connect()) connect: client 9fd65f33-d046-43bb-9119-74a1dce1ebb4, cookie 0xca72b3b3356401df 00000004:00100000:3.0:1787432782.960194:0:17154:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787432782.960317:0:17154:0:(import.c:65:import_set_state_nolock()) ffff948304712000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432782.960387:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2399:x1874258588461440:12345-192.168.204.24@tcp:38:mount.lustre.0 Request processed in 309us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432782.960414:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:3.0:1787432782.960434:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:3.0:1787432782.960439:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1874258588461696:12345-192.168.204.24@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787432782.960457:0:17154:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 9fd65f33-d046-43bb-9119-74a1dce1ebb4@192.168.204.24@tcp t0 exp 0000000000000000 cur 594 last 0 00000020:00000080:3.0:1787432782.960479:0:17154:0:(genops.c:1385:class_connect()) connect: client 9fd65f33-d046-43bb-9119-74a1dce1ebb4, cookie 0xca72b3b3356401e6 00000004:00100000:3.0:1787432782.960492:0:17154:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787432782.960536:0:17154:0:(import.c:65:import_set_state_nolock()) ffff948304714000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432782.960562:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2399:x1874258588461696:12345-192.168.204.24@tcp:38:mount.lustre.0 Request processed in 121us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432782.960569:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:1.0:1787432782.973600:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432782.973640:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432782.973684:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432782.973763:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588461952 00000100:00100000:0.0:1787432782.973774:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588461952 00000100:00100000:0.0:1787432782.973831:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588461824 00000100:00100000:0.0:1787432782.973835:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588461824 00000100:00100000:0.0:1787432782.973847:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588461568 00000100:00100000:0.0:1787432782.973849:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588461568 00000100:00100000:0.0:1787432782.973862:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00100000:0.0:1787432782.973870:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+7:15069:x1874258588461952:12345-192.168.204.24@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787432782.973908:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787432782.973999:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+7:15069:x1874258588461952:12345-192.168.204.24@tcp:41:mount.lustre.0 Request processed in 128us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432782.974007:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00100000:0.0:1787432782.974037:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 19 00000100:00100000:0.0:1787432782.974044:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:0:x1874258588461824:12345-192.168.204.24@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787432782.974061:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787432782.974090:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:0:x1874258588461824:12345-192.168.204.24@tcp:41:mount.lustre.0 Request processed in 47us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432782.974096:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 19 00000100:00100000:0.0:1787432782.974106:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00100000:0.0:1787432782.974112:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:0:x1874258588461568:12345-192.168.204.24@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787432782.974121:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787432782.974140:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:0:x1874258588461568:12345-192.168.204.24@tcp:41:mount.lustre.0 Request processed in 27us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432782.974161:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00080000:1.0:1787432782.974751:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432782.974757:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432782.977113:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432782.977256:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588462720 00000100:00100000:0.0:1787432782.977265:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588462720 00000100:00100000:0.0:1787432782.977323:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:0.0:1787432782.977336:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:15069:x1874258588462720:12345-192.168.204.24@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787432782.977437:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:15069:x1874258588462720:12345-192.168.204.24@tcp:40:mount.lustre.0 Request processed in 103us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432782.977446:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:0.0:1787432782.982466:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432782.982523:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432782.982564:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432782.982703:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588463104 00000100:00100000:2.0:1787432782.982714:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588463104 00000100:00100000:2.0:1787432782.982780:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 4 00000100:00100000:2.0:1787432782.982793:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484359eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:15069:x1874258588463104:12345-192.168.204.24@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787432782.982882:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484359eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:15069:x1874258588463104:12345-192.168.204.24@tcp:900:mount.lustre.0 Request processed in 91us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432782.982907:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 4 00010000:00010000:0.0:1787432782.987348:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432782.990328:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588462848 00000100:00100000:3.0:1787432782.990348:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588462848 00000100:00100000:0.0:1787432782.990514:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588462976 00000100:00100000:0.0:1787432782.990519:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588462976 00000100:00100000:0.0:1787432782.990552:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:0.0:1787432782.990561:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1874258588462848:12345-192.168.204.24@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787432782.990603:0:18661:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9fd65f33-d046-43bb-9119-74a1dce1ebb4@192.168.204.24@tcp t0 exp 0000000000000000 cur 594 last 0 00000020:00000080:0.0:1787432782.990641:0:18661:0:(genops.c:1385:class_connect()) connect: client 9fd65f33-d046-43bb-9119-74a1dce1ebb4, cookie 0xca72b3b3356401ed 00002000:00100000:0.0:1787432782.990655:0:18661:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9fd65f33-d046-43bb-9119-74a1dce1ebb4/ffff94842d4c5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1787432782.990762:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:2.0:1787432782.990770:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1874258588462976:12345-192.168.204.24@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787432782.990818:0:19127:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9fd65f33-d046-43bb-9119-74a1dce1ebb4@192.168.204.24@tcp t0 exp 0000000000000000 cur 594 last 0 00000020:00000080:2.0:1787432782.990838:0:19127:0:(genops.c:1385:class_connect()) connect: client 9fd65f33-d046-43bb-9119-74a1dce1ebb4, cookie 0xca72b3b3356401f4 00002000:00100000:2.0:1787432782.990843:0:19127:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9fd65f33-d046-43bb-9119-74a1dce1ebb4/ffff948301e05800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787432782.990853:0:19127:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787432782.990953:0:19127:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787432782.990997:0:19127:0:(import.c:65:import_set_state_nolock()) ffff9484348a7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432782.991453:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2399:x1874258588462976:12345-192.168.204.24@tcp:8:mount.lustre.0 Request processed in 678us (8884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432782.991462:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 22 00002000:00100000:0.0:1787432782.991539:0:18661:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787432782.991589:0:18661:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787432782.991607:0:18661:0:(import.c:65:import_set_state_nolock()) ffff94842d4c6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432782.991634:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2399:x1874258588462848:12345-192.168.204.24@tcp:8:mount.lustre.0 Request processed in 1073us (9111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432782.991642:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:0.0:1787432782.996017:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432782.996147:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588463232 00000100:00100000:1.0:1787432782.996159:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588463232 00000100:00100000:1.0:1787432782.996252:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1 00000100:00100000:1.0:1787432782.996264:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:15069:x1874258588463232:12345-192.168.204.24@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787432782.996378:0:17158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787432782.996475:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:15069:x1874258588463232:12345-192.168.204.24@tcp:33:mount.lustre.0 Request processed in 213us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432782.996483:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1 00000100:00100000:0.0:1787432783.160279:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432783.160420:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588463360 00000100:00100000:3.0:1787432783.160431:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588463360 00000100:00100000:3.0:1787432783.160496:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:3.0:1787432783.160507:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:15102:x1874258588463360:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:3.0:1787432783.160533:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432783.160556:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b3356401fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d520e expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.160624:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b335640202 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.160639:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b335640202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.160650:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b335640202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432783.160710:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787432783.160713:0:17154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787432783.160732:0:17154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b335640202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.160758:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b3356401fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d520e expref: 8 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.160775:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b335640202 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d520e expref: 7 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.160784:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9483026f7400) 00010000:00010000:3.0:1787432783.160787:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432783.160791:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e400, rc 0) 00000100:00100000:3.0:1787432783.160860:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+7:15102:x1874258588463360:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 354us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432783.160868:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:3.0:1787432783.307548:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432783.307571:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609514624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432783.307643:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432783.307818:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609514752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432783.307843:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432783.307921:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609514624 00000100:00100000:2.0:1787432783.307929:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609514624 00000100:00100000:2.0:1787432783.307992:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609514752 00000100:00100000:2.0:1787432783.307996:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609514752 00000100:00100000:2.0:1787432783.308013:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787432783.308031:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609514624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787432783.308057:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787432783.308102:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609514624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432783.308109:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787432783.308125:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787432783.308132:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609514752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787432783.308160:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787432783.308232:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609514752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432783.308239:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787432783.308376:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609514752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432783.308389:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609514624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432783.308601:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432783.308617:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609514880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787432783.308648:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432783.308760:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609514880 00000100:00100000:1.0:1787432783.308765:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609514880 00000100:00100000:1.0:1787432783.308817:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787432783.308824:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609514880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787432783.308838:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787432783.308879:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609514880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432783.308885:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787432783.308915:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609514880:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787432783.308977:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787432784.011395:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432785.037182:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787432785.483894:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1787432785.876855:0:17134:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9fd65f33-d046-43bb-9119-74a1dce1ebb4 00000001:00100000:1.0:1787432785.876870:0:17134:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 17ee1936-2707-48b4-a113-f80e95ac94b4 00000001:00100000:1.0:1787432785.877359:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9fd65f33-d046-43bb-9119-74a1dce1ebb4 00000001:00100000:1.0:1787432785.877366:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 17ee1936-2707-48b4-a113-f80e95ac94b4 00000001:00100000:0.0:1787432785.879466:0:17886:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9fd65f33-d046-43bb-9119-74a1dce1ebb4 00000001:00100000:0.0:1787432785.879481:0:17886:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 17ee1936-2707-48b4-a113-f80e95ac94b4 00010000:00010000:0.0:1787432786.060113:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787432786.300898:0:20032:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1787432786.380457:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432786.380477:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609515008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432786.380550:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432786.382040:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609515136:0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.382097:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432786.382134:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609515648:0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.382158:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432786.382196:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609516160:0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.382218:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432786.382242:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787432786.382248:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609515264:0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.382269:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432786.382297:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609515776:0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.382318:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432786.382334:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609516288:0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.382352:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432786.382381:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609515648 00000100:00100000:3.0:1787432786.382388:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609515648 00000100:00100000:3.0:1787432786.382436:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609515264 00000100:00100000:3.0:1787432786.382438:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609515264 00000100:00100000:3.0:1787432786.382456:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787432786.382467:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609515648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.383799:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609515648:12345-0@lo:400:kworker.0 Request processed in 1328us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432786.383910:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609515648:0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.383962:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787432786.383985:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787432786.384009:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609515264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.384080:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609515264:12345-0@lo:400:kworker.0 Request processed in 74us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432786.384086:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787432786.384109:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609516160 00000100:00100000:3.0:1787432786.384124:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609516160 00000100:00100000:3.0:1787432786.384176:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609516288 00000100:00100000:3.0:1787432786.384178:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609516288 00000100:00100000:3.0:1787432786.384191:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787432786.384197:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609516160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.384225:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609516160:12345-0@lo:400:kworker.0 Request processed in 28us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432786.384230:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787432786.384240:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787432786.384245:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609516288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.384264:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874258609516288:12345-0@lo:400:kworker.0 Request processed in 20us (1912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432786.384269:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787432786.384298:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609515776 00000100:00100000:3.0:1787432786.384302:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609515776 00000100:00100000:3.0:1787432786.384325:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787432786.384331:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609515776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.384356:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609515776:12345-0@lo:400:kworker.0 Request processed in 25us (2037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432786.384361:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787432786.384379:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787432786.384384:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432786.384391:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432786.384410:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609515392:0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.384440:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432786.384458:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609515904:0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.384474:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432786.384494:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609516416:0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.384511:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432786.384526:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787432786.384531:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609515520:0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.384547:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432786.384558:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609516032:0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.384572:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432786.384581:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609516544:0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.384596:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432786.384610:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609515392 00000100:00100000:3.0:1787432786.384613:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609515392 00000100:00100000:3.0:1787432786.384634:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609515904 00000100:00100000:1.0:1787432786.384978:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787432786.384993:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609515392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432786.385063:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609515392:12345-0@lo:400:kworker.0 Request processed in 75us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432786.385070:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787432786.385100:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609515008 00000100:00100000:1.0:1787432786.385105:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609515008 00000100:00100000:1.0:1787432786.385147:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787432786.385154:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609515008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787432786.385196:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787432786.385233:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609515008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (4683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432786.385240:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787432786.385262:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609515136 00000100:00100000:1.0:1787432786.385266:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609515136 00000100:00100000:1.0:1787432786.385293:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787432786.385300:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3643:x1874258609515136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432786.385334:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3643:x1874258609515136:12345-0@lo:400:kworker.0 Request processed in 34us (3236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432786.385340:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787432786.385426:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609515904 00000100:00100000:3.0:1787432786.385459:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787432786.385466:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609515904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.385562:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609515904:12345-0@lo:400:kworker.0 Request processed in 96us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432786.385568:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787432786.385586:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609516416 00000100:00100000:3.0:1787432786.385590:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609516416 00000100:00100000:3.0:1787432786.385734:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609515520 00000100:00100000:3.0:1787432786.385738:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609515520 00000100:00100000:3.0:1787432786.385759:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609516032 00000100:00100000:3.0:1787432786.385762:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609516032 00000100:00100000:3.0:1787432786.385774:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609516544 00000100:00100000:3.0:1787432786.385777:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609516544 00000100:00100000:3.0:1787432786.385791:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787432786.385797:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609516416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.386186:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874258609516416:12345-0@lo:400:kworker.0 Request processed in 366us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432786.386194:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787432786.386207:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787432786.386214:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609515520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.386243:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874258609515520:12345-0@lo:400:kworker.0 Request processed in 31us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432786.386248:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787432786.386257:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787432786.386263:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609516032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.386377:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874258609516032:12345-0@lo:400:kworker.0 Request processed in 114us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432786.386384:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787432786.386394:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787432786.386400:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609516544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.386422:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874258609516544:12345-0@lo:400:kworker.0 Request processed in 23us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432786.386426:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787432786.386448:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432786.386452:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432786.386454:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432786.386463:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432786.386475:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432786.388141:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609516672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787432786.388893:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432786.388983:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874258609515520:0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.388994:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874258609516032:0@lo:400:kworker.0 00010000:00080000:3.0:1787432786.389009:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303adb800 x1874258609516544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432786.389020:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1874258609516544:0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.389031:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609515392:0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.389039:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609515904:0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.389049:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1874258609516416:0@lo:400:kworker.0 00000100:00100000:3.0:1787432786.389060:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1787432786.389080:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609515008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432786.390187:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609516672 00000100:00100000:1.0:1787432786.390198:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609516672 00000100:00100000:1.0:1787432786.390258:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787432786.390269:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609516672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787432786.390311:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787432786.390387:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609516672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432786.390395:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787432786.390760:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609516672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432786.394449:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609515264:0@lo:400:kworker.0 00000100:00100000:2.0:1787432786.394468:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609515776:0@lo:400:kworker.0 00010000:00080000:2.0:1787432786.394481:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948303ad8000 x1874258609516288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432786.394502:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1874258609516288:0@lo:400:kworker.0 00000100:00100000:2.0:1787432786.394513:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3643:1874258609515136:0@lo:400:kworker.0 00000100:00100000:2.0:1787432786.394524:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609516160:0@lo:400:kworker.0 00010000:00010000:0.0:1787432787.083975:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432787.403364:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948435b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609516800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432787.403437:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432787.403714:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609516800 00000100:00100000:1.0:1787432787.403724:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609516800 00000100:00100000:1.0:1787432787.403845:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787432787.403856:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609516800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432787.403893:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787432787.403948:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609516800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432787.403965:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787432787.404043:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948435b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609516800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432788.001986:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432788.002063:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588463488 00000100:00100000:0.0:1787432788.002073:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588463488 00000100:00100000:0.0:1787432788.002136:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 148 00000100:00100000:0.0:1787432788.002146:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:2403:x1874258588463488:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432788.002255:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:2403:x1874258588463488:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 110us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432788.002263:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 148 00000100:00100000:2.0:1787432788.014262:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432788.014294:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432788.014326:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432788.014347:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432788.014361:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432788.014380:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432788.014403:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588463872 00000100:00100000:2.0:1787432788.014427:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588463872 00000100:00100000:2.0:1787432788.014487:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588464000 00000100:00100000:1.0:1787432788.014490:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588463616 00000100:00100000:2.0:1787432788.014491:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588464000 00000100:00100000:1.0:1787432788.014494:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588463616 00000100:00100000:2.0:1787432788.014513:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00100000:1.0:1787432788.014516:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588463744 00000100:00100000:1.0:1787432788.014518:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588463744 00000100:00100000:2.0:1787432788.014524:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588463872:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432788.014528:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588464128 00000100:00100000:1.0:1787432788.014530:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588464128 00000100:00100000:1.0:1787432788.014539:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588464256 00000100:00100000:1.0:1787432788.014540:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588464256 00000100:00100000:1.0:1787432788.014552:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 49 00000100:00100000:1.0:1787432788.014558:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+6:2403:x1874258588463616:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432788.014625:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00100000:3.0:1787432788.014635:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588464000:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432788.014696:0:17155:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787432788.014704:0:17155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787432788.014807:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 50 00000100:00100000:0.0:1787432788.014815:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588463744:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432788.014884:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588463872:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 362us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432788.014892:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00100000:1.0:1787432788.015025:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+6:2403:x1874258588463616:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 465us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432788.015032:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 49 00000100:00100000:1.0:1787432788.015045:0:17154:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787432788.015051:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 51 00000100:00100000:1.0:1787432788.015058:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2403:x1874258588464128:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432788.015080:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2403:x1874258588464128:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432788.015087:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 51 00000100:00100000:1.0:1787432788.015096:0:17154:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787432788.015101:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00100000:1.0:1787432788.015107:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2403:x1874258588464256:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432788.015127:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2403:x1874258588464256:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 21us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432788.015132:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00100000:3.0:1787432788.018515:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588464000:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 3865us (4149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432788.018532:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00080000:3.0:1787432788.018628:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432788.018649:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432788.018653:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432788.018656:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432788.018718:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432788.018827:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588464384 00000100:00100000:1.0:1787432788.018837:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588464384 00000100:00080000:2.0:1787432788.018884:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432788.018915:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432788.018978:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588464512 00000100:00100000:1.0:1787432788.018982:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588464512 00000100:00100000:1.0:1787432788.019008:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:1.0:1787432788.019016:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2403:x1874258588464384:12345-192.168.204.24@tcp:400:kworker.0 00000100:00080000:2.0:1787432788.019066:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432788.019071:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2403:x1874258588464384:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 55us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432788.019077:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:1.0:1787432788.019090:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:1.0:1787432788.019097:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2403:x1874258588464512:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432788.019720:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2403:x1874258588464512:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 619us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432788.019728:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:0.0:1787432788.022735:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588463744:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 7904us (8422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432788.022751:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 50 00010000:00010000:1.0:1787432788.111905:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432788.427408:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609516928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432788.427481:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432788.427604:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609516928 00000100:00100000:1.0:1787432788.427612:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609516928 00000100:00100000:1.0:1787432788.427680:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787432788.427690:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609516928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787432788.427712:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787432788.427762:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609516928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432788.427769:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787432788.427936:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432788.427961:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609516928:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787432788.434376:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432788.434408:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609517056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432788.434474:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432788.434524:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609517056 00000100:00100000:0.0:1787432788.434531:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609517056 00000100:00100000:0.0:1787432788.434576:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787432788.434587:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609517056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432788.434619:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787432788.434665:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609517056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432788.434672:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787432788.434720:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609517056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787432788.437148:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609517184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432788.437242:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432788.437760:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609517184 00000100:00100000:3.0:1787432788.437770:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609517184 00000100:00100000:3.0:1787432788.438135:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787432788.438147:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948435b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609517184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787432788.438200:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787432788.438253:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948435b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609517184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432788.438261:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787432788.438359:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609517184:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1787432788.941450:0:19475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9fd65f33-d046-43bb-9119-74a1dce1ebb4 00010000:00010000:0.0:1787432789.131271:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787432789.592848:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1787432790.038030:0:20181:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc2d7c4d50 20000000:00000080:0.0:1787432790.038047:0:20181:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff948441112800 uarg=0000000000000000 20000000:01000000:0.0:1787432790.038099:0:20181:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787432790.038105:0:20181:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787432790.038110:0:20181:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787432790.038860:0:20182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1787432790.039030:0:20181:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787432790.045541:0:20181:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787432790.045576:0:20181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff948304488400/0xca72b3b335640209 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432790.045597:0:20181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948303850c00/0xca72b3b33563fe9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fe97 expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432790.045606:0:20181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484032e5e00/0xca72b3b33563feac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fea5 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432790.045635:0:20181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484032e4800/0xca72b3b33563feeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33563fee4 expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432790.045641:0:20181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9484032e4200/0xca72b3b335640050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b335640049 expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432790.045651:0:20181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948304489000/0xca72b3b335640199 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d516d expref: 12 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432790.045659:0:20181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff948302690e00/0xca72b3b3356401d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d51dd expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432790.045666:0:20181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff948304488400/0xca72b3b335640209 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432790.045712:0:20181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948302690e00/0xca72b3b3356401d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d51dd expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432790.045727:0:20181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948302690e00/0xca72b3b3356401d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d51dd expref: 12 pid: 17149 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432790.045741:0:20181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1874258609517312:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432790.045860:0:20181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948304489000/0xca72b3b335640199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d516d expref: 12 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432790.045868:0:20181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948304489000/0xca72b3b335640199 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d516d expref: 12 pid: 17148 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432790.045877:0:20181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1874258609517440:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432790.045916:0:20181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484032e4200/0xca72b3b335640050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b335640049 expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432790.045925:0:20181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9484032e4200/0xca72b3b335640050 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b335640049 expref: 23 pid: 17148 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432790.045935:0:20181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a38a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1874258609517568:0@lo:104: 00000100:00100000:0.0:1787432790.045974:0:20181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432790.046021:0:20181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484032e4800/0xca72b3b33563feeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563fee4 expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432790.046029:0:20181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9484032e4800/0xca72b3b33563feeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563fee4 expref: 23 pid: 17149 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432790.046037:0:20181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303a3a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1874258609517696:0@lo:104: 00000100:00100000:0.0:1787432790.046057:0:20181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432790.046078:0:20181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9484032e5e00/0xca72b3b33563feac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563fea5 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432790.046085:0:20181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9484032e5e00/0xca72b3b33563feac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563fea5 expref: 23 pid: 17147 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432790.046094:0:20181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1874258609517824:0@lo:104: 00000100:00100000:0.0:1787432790.046114:0:20181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432790.046338:0:20181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff948303850c00/0xca72b3b33563fe9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xca72b3b33563fe97 expref: 23 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432790.046349:0:20181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff948303850c00/0xca72b3b33563fe9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xca72b3b33563fe97 expref: 23 pid: 17148 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432790.046369:0:20181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1874258609517952:0@lo:104: 00000100:00100000:0.0:1787432790.046393:0:20181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432790.046404:0:20181:0:(client.c:2715:ptlrpc_set_wait()) set ffff948403cafcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432790.046485:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609517568 00000100:00100000:2.0:1787432790.046501:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609517568 00000100:00100000:2.0:1787432790.046550:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609517696 00000100:00100000:2.0:1787432790.046553:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609517696 00000100:00100000:2.0:1787432790.046564:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609517824 00000100:00100000:2.0:1787432790.046566:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609517824 00000100:00100000:2.0:1787432790.046576:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609517952 00000100:00100000:2.0:1787432790.046578:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609517952 00000100:00100000:2.0:1787432790.046590:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787432790.046599:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303a39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+6:20181:x1874258609517568:12345-0@lo:104: 00010000:00010000:2.0:1787432790.046612:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948303850000/0xca72b3b335640049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b335640050 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.046687:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787432790.046693:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303a39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+6:20181:x1874258609517568:12345-0@lo:104: Request processed in 96us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432790.046701:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787432790.046719:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787432790.046725:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+5:20181:x1874258609517696:12345-0@lo:104: 00010000:00010000:2.0:1787432790.046733:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fee4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563feeb expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.046767:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787432790.046772:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+5:20181:x1874258609517696:12345-0@lo:104: Request processed in 48us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432790.046778:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787432790.046790:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432790.046797:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+4:20181:x1874258609517824:12345-0@lo:104: 00010000:00010000:2.0:1787432790.046804:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9483039f1800/0xca72b3b33563fea5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563feac expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.046848:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787432790.046853:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+4:20181:x1874258609517824:12345-0@lo:104: Request processed in 58us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432790.046858:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432790.046870:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787432790.046876:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+3:20181:x1874258609517952:12345-0@lo:104: 00010000:00010000:2.0:1787432790.046883:0:17138:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff9483039f1a00/0xca72b3b33563fe97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563fe9e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.046917:0:17138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787432790.046921:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+3:20181:x1874258609517952:12345-0@lo:104: Request processed in 46us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432790.046927:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787432790.046948:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787432790.046954:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948303850000/0xca72b3b335640049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b335640050 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.046962:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948303850000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432790.046966:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948303850000/0xca72b3b335640049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b335640050 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.046973:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948303850000/0xca72b3b335640049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b335640050 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432790.046980:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948303850000/0xca72b3b335640049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b335640050 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432790.046985:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787432790.047018:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948303850000/0xca72b3b335640049 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b335640050 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.047025:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432790.047044:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948303850000/0xca72b3b335640049 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b335640050 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.047050:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948303850000/0xca72b3b335640049 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b335640050 expref: -99 pid: 19474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.047073:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787432790.047076:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fee4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563feeb expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.047082:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432790.047084:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fee4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563feeb expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.047091:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fee4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563feeb expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432790.047097:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fee4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563feeb expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432790.047102:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787432790.047117:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fee4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563feeb expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.047123:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432790.047330:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fee4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563feeb expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.047337:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff948304489600/0xca72b3b33563fee4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563feeb expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.047347:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787432790.047350:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9483039f1800/0xca72b3b33563fea5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563feac expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.047365:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1800 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432790.047368:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9483039f1800/0xca72b3b33563fea5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563feac expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.047374:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9483039f1800/0xca72b3b33563fea5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563feac expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432790.047379:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9483039f1800/0xca72b3b33563fea5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563feac expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432790.047383:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787432790.047398:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9483039f1800/0xca72b3b33563fea5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563feac expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.047404:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432790.047409:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9483039f1800/0xca72b3b33563fea5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563feac expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.047414:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9483039f1800/0xca72b3b33563fea5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563feac expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.047423:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432790.047426:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff9483039f1a00/0xca72b3b33563fe97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xca72b3b33563fe9e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.047430:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9483039f1a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1787432790.047433:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff9483039f1a00/0xca72b3b33563fe97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xca72b3b33563fe9e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.047449:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff9483039f1a00/0xca72b3b33563fe97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xca72b3b33563fe9e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432790.047456:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff9483039f1a00/0xca72b3b33563fe97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xca72b3b33563fe9e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432790.047460:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787432790.047472:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff9483039f1a00/0xca72b3b33563fe97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fe9e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.047477:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432790.047483:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff9483039f1a00/0xca72b3b33563fe97 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fe9e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.047584:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff9483039f1a00/0xca72b3b33563fe97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xca72b3b33563fe9e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.047599:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432790.047601:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432790.047602:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432790.047611:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432790.047617:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432790.047630:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3644:1874258609518080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432790.047666:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432790.047704:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432790.047709:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3644:1874258609518464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432790.047730:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432790.047757:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3641:1874258609518208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432790.047787:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432790.047805:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432790.047810:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483045e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3641:1874258609518336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432790.047840:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432790.047869:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609518080 00000100:00100000:2.0:1787432790.047874:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609518080 00010000:00010000:2.0:1787432790.047895:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484032e4200/0xca72b3b335640050 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b335640049 expref: 24 pid: 17148 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432790.047909:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609518464 00000100:00100000:2.0:1787432790.047912:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609518464 00010000:00010000:2.0:1787432790.047922:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948303850c00/0xca72b3b33563fe9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fe97 expref: 25 pid: 17148 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432790.047931:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609518208 00000100:00100000:2.0:1787432790.047933:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609518208 00010000:00010000:2.0:1787432790.047943:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484032e4800/0xca72b3b33563feeb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fee4 expref: 26 pid: 17149 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432790.047951:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609518336 00000100:00100000:2.0:1787432790.047954:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609518336 00010000:00010000:2.0:1787432790.047962:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9484032e5e00/0xca72b3b33563feac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fea5 expref: 27 pid: 17147 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432790.047972:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787432790.047979:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+27:3644:x1874258609518080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432790.047988:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432790.047993:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484032e4200/0xca72b3b335640050 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b335640049 expref: 27 pid: 17148 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.048013:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484032e4200/0xca72b3b335640050 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b335640049 expref: 27 pid: 17148 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.048030:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432790.048061:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+27:3644:x1874258609518080:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432790.048068:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787432790.048085:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787432790.048092:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+26:3644:x1874258609518464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432790.048099:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432790.048104:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948303850c00/0xca72b3b33563fe9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fe97 expref: 26 pid: 17148 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.048111:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948303850c00/0xca72b3b33563fe9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563fe97 expref: 26 pid: 17148 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432790.048121:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432790.048648:0:20181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e4200/0xca72b3b335640050 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b335640049 expref: 26 pid: 17148 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432790.048662:0:20181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a38a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1874258609517568:0@lo:104: 00000100:00100000:0.0:1787432790.048673:0:20181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1874258609517696:0@lo:104: 00000100:00100000:0.0:1787432790.048680:0:20181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1874258609517824:0@lo:104: 00010000:00010000:0.0:1787432790.048688:0:20181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948303850c00/0xca72b3b33563fe9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563fe97 expref: 25 pid: 17148 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432790.048695:0:20181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1874258609517952:0@lo:104: 00000100:00100000:3.0:1787432790.051457:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787432790.051479:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3641:x1874258609518208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432790.051504:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432790.051516:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484032e4800/0xca72b3b33563feeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fee4 expref: 24 pid: 17149 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432790.051554:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484032e4800/0xca72b3b33563feeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563fee4 expref: 24 pid: 17149 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432790.051575:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e4800/0xca72b3b33563feeb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563fee4 expref: 24 pid: 17149 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432790.051591:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432790.051675:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:3641:x1874258609518208:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (3886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432790.051695:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787432790.051722:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787432790.051729:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:3641:x1874258609518336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432790.051737:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432790.051741:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9484032e5e00/0xca72b3b33563feac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xca72b3b33563fea5 expref: 22 pid: 17147 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432790.051750:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9484032e5e00/0xca72b3b33563feac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xca72b3b33563fea5 expref: 22 pid: 17147 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432790.051760:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9484032e5e00/0xca72b3b33563feac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xca72b3b33563fea5 expref: 22 pid: 17147 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432790.051768:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432790.051793:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:3641:x1874258609518336:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (3963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432790.051799:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787432790.052022:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3641:1874258609518336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432790.052034:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3641:1874258609518208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432790.052289:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:3644:x1874258609518464:12345-0@lo:103:ldlm_bl.0 Request processed in 4196us (4556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432790.052298:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787432790.052328:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3644:1874258609518464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432790.052337:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483045e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3644:1874258609518080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432790.052704:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432790.052736:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432790.052807:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588464768 00000100:00100000:1.0:1787432790.052815:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588464768 00010000:00010000:1.0:1787432790.052865:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948304489000/0xca72b3b335640199 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d516d expref: 13 pid: 17148 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432790.052894:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588464640 00000100:00100000:1.0:1787432790.052897:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588464640 00010000:00010000:1.0:1787432790.052909:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff948302690e00/0xca72b3b3356401d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d51dd expref: 14 pid: 17149 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432790.052926:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 13 00000100:00100000:1.0:1787432790.052945:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+14:2402:x1874258588464768:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432790.052955:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432790.052959:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948304489000/0xca72b3b335640199 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d516d expref: 14 pid: 17148 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432790.052969:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948304489000/0xca72b3b335640199 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d516d expref: 14 pid: 17148 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432790.052982:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432790.053021:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+14:2402:x1874258588464768:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 88us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432790.053028:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 13 00000100:00100000:1.0:1787432790.053069:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00100000:1.0:1787432790.053077:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:2402:x1874258588464640:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432790.053084:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432790.053089:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff948302690e00/0xca72b3b3356401d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d51dd expref: 13 pid: 17149 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432790.053098:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff948302690e00/0xca72b3b3356401d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d51dd expref: 13 pid: 17149 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432790.053116:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff948304488400/0xca72b3b335640209 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432790.053123:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948304488400/0xca72b3b335640209 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432790.053236:0:17139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948304488400/0xca72b3b335640209 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432790.053243:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff948304488400/0xca72b3b335640209 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432790.053250:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff948304488400/0xca72b3b335640209 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432790.053257:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff948304488400/0xca72b3b335640209 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432790.053263:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304488400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432790.053266:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff948304488400/0xca72b3b335640209 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432790.053273:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff948304488400/0xca72b3b335640209 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432790.053282:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff948304488400/0xca72b3b335640209 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432790.053291:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432790.053312:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:2402:x1874258588464640:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 237us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432790.053328:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 14 00010000:00010000:0.0:1787432790.054271:0:20181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948302690e00/0xca72b3b3356401d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d51dd expref: 12 pid: 17149 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432790.054285:0:20181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1874258609517312:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432790.054298:0:20181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948304489000/0xca72b3b335640199 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d516d expref: 11 pid: 17148 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432790.054307:0:20181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303a3b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20181:1874258609517440:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432790.054337:0:20181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff948304488400/0xca72b3b335640209 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432790.054356:0:20181:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff948304488400/0xca72b3b335640209 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432790.054362:0:20181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff948304488400/0xca72b3b335640209 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432790.054367:0:20181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff948304488400/0xca72b3b335640209 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432790.160681:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432791.194598:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787432791.308489:0:17151:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787432791.308506:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948301d52800 from 13 10000000:01000000:3.0:1787432791.308512:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787432791.308564:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640210 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432791.308576:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640210 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432791.308588:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640210 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432791.308629:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609518592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432791.308707:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432791.308758:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432791.310536:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609518592 00000100:00100000:1.0:1787432791.310549:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609518592 00000100:00100000:1.0:1787432791.310637:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787432791.310647:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+20:17151:x1874258609518592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432791.310663:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432791.310685:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302691a00/0xca72b3b335640217 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b335640210 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432791.310710:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302691a00/0xca72b3b335640217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b335640210 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432791.310721:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302691a00/0xca72b3b335640217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b335640210 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432791.310730:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302691a00, rc 0) 00000100:00100000:1.0:1787432791.310796:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:17151:x1874258609518592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (2089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432791.310833:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787432791.311057:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609518592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432791.311076:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640210 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640217 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432791.311085:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640210 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640217 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432791.311247:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609518720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432791.311286:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432791.311320:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609518720 00000100:00100000:3.0:1787432791.311323:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432791.311327:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609518720 00000100:00100000:2.0:1787432791.311424:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787432791.311432:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:17151:x1874258609518720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432791.311562:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:17151:x1874258609518720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432791.311568:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787432791.312274:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609518720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432791.312315:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609518848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432791.312363:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432791.312399:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432791.312441:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609518848 00000100:00100000:0.0:1787432791.312447:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609518848 00000100:00100000:0.0:1787432791.312485:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787432791.312495:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:17151:x1874258609518848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432791.312608:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:17151:x1874258609518848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432791.312616:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787432791.312675:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609518848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787432791.314744:0:20231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787432791.319933:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787432791.319979:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432791.319994:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640210 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640217 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432791.320007:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff94843f85e600/0xca72b3b335640210 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640217 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432791.320019:0:17151:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787432791.320282:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff948301dc6000 from 13 10000000:01000000:2.0:1787432791.320286:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787432791.320330:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f04400/0xca72b3b33564021e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432791.320342:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948301f04400/0xca72b3b33564021e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432791.320364:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948301f04400/0xca72b3b33564021e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432791.320405:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304569880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609518976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787432791.320502:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432791.320558:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841de44d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432791.320835:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609518976 00000100:00100000:1.0:1787432791.320843:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609518976 00000100:00100000:1.0:1787432791.320900:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787432791.320911:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+21:17151:x1874258609518976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432791.320924:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432791.320937:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302690e00/0xca72b3b335640225 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33564021e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432791.320958:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302690e00/0xca72b3b335640225 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33564021e expref: 22 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432791.320978:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302690e00/0xca72b3b335640225 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33564021e expref: 22 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432791.320986:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302690e00, rc 0) 00000100:00100000:1.0:1787432791.321049:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:17151:x1874258609518976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432791.321056:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787432791.321226:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304569880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609518976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432791.321244:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948301f04400/0xca72b3b33564021e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640225 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432791.321256:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948301f04400/0xca72b3b33564021e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640225 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432791.321334:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609519104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432791.321366:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432791.321406:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432791.321456:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609519104 00000100:00100000:2.0:1787432791.321468:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609519104 00000100:00100000:2.0:1787432791.321502:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787432791.321509:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:17151:x1874258609519104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432791.321628:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:17151:x1874258609519104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432791.321636:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787432791.321662:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609519104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432791.321695:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609519232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432791.321736:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432791.321761:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432791.321834:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609519232 00000100:00100000:2.0:1787432791.321839:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609519232 00000100:00100000:2.0:1787432791.321882:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787432791.321890:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:17151:x1874258609519232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432791.321978:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:17151:x1874258609519232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432791.321985:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787432791.322072:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609519232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787432791.323096:0:20233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787432791.323608:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787432791.323630:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432791.323641:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f04400/0xca72b3b33564021e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640225 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432791.323651:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948301f04400/0xca72b3b33564021e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640225 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432791.323662:0:17151:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787432791.323664:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94843f837000 from 13 10000000:01000000:2.0:1787432791.323667:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787432791.323697:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b33564022c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432791.323705:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b33564022c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432791.323729:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b33564022c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432791.323751:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304569f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609519360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787432791.323801:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432791.323928:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609519360 00000100:00100000:1.0:1787432791.323934:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609519360 00000100:00100000:1.0:1787432791.323981:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787432791.323989:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+22:17151:x1874258609519360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432791.323999:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432791.324012:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302690c00/0xca72b3b335640233 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33564022c expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432791.324031:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302690c00/0xca72b3b335640233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33564022c expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432791.324040:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302690c00/0xca72b3b335640233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33564022c expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432791.324047:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302690c00, rc 0) 00000100:00100000:1.0:1787432791.324076:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:17151:x1874258609519360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432791.324082:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787432791.324159:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841de44d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432791.324210:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304569f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609519360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432791.324222:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b33564022c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640233 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432791.324230:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b33564022c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640233 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432791.324277:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304569f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609519488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432791.324299:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432791.324311:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841de44d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432791.324323:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609519488 00000100:00100000:2.0:1787432791.324325:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609519488 00000100:00100000:2.0:1787432791.324346:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787432791.324352:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303bcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:17151:x1874258609519488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432791.324441:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303bcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:17151:x1874258609519488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432791.324447:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787432791.328045:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304569f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609519488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432791.328112:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304569f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609519616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432791.329422:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432791.329460:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff94841de44d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432791.329628:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609519616 00000100:00100000:2.0:1787432791.329635:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609519616 00000100:00100000:2.0:1787432791.329798:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787432791.329818:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948402c9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:17151:x1874258609519616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432791.329948:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948402c9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:17151:x1874258609519616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432791.329956:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787432791.330067:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304569f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609519616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787432791.335116:0:20234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787432791.335729:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787432791.335760:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787432791.335786:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b33564022c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640233 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432791.335799:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948301f05e00/0xca72b3b33564022c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640233 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432791.335826:0:17151:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787432791.335829:0:17151:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9483038e1000 from 13 10000000:01000000:1.0:1787432791.335832:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787432791.335882:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b33564023a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432791.335890:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b33564023a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432791.335901:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b33564023a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432791.335927:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609519744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787432791.335993:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432791.336044:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bbe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432791.336285:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609519744 00000100:00100000:2.0:1787432791.336292:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609519744 00000100:00100000:2.0:1787432791.336343:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787432791.336353:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948402c9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+23:17151:x1874258609519744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432791.336368:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432791.336382:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948301f05400/0xca72b3b335640241 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xca72b3b33564023a expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432791.336406:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948301f05400/0xca72b3b335640241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xca72b3b33564023a expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432791.336416:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948301f05400/0xca72b3b335640241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xca72b3b33564023a expref: 24 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432791.336425:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f05400, rc 0) 00000100:00100000:2.0:1787432791.336479:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948402c9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:17151:x1874258609519744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432791.336485:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787432791.336787:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609519744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432791.336814:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b33564023a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640241 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432791.336824:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b33564023a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xca72b3b335640241 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432791.336892:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609519872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432791.336934:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432791.336958:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bbe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432791.337050:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609519872 00000100:00100000:2.0:1787432791.337055:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609519872 00000100:00100000:2.0:1787432791.337091:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787432791.337097:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:17151:x1874258609519872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432791.337214:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:17151:x1874258609519872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432791.337221:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787432791.337290:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609519872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432791.337316:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609520000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432791.337351:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432791.337371:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff948434bbe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432791.338156:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609520000 00000100:00100000:2.0:1787432791.338186:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609520000 00000100:00100000:2.0:1787432791.338220:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787432791.338227:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:17151:x1874258609520000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432791.338313:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:17151:x1874258609520000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432791.338319:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787432791.338416:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:17151:1874258609520000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787432791.339463:0:20236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787432791.340692:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787432791.340719:0:17151:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432791.340732:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b33564023a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640241 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432791.340744:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff948302690000/0xca72b3b33564023a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xca72b3b335640241 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432791.501020:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609520256:0@lo:400:kworker.0 00000100:00100000:0.0:1787432791.501094:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432791.501135:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609520768:0@lo:400:kworker.0 00000100:00100000:0.0:1787432791.501161:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432791.501184:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609520128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432791.501202:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609521280:0@lo:400:kworker.0 00000100:00100000:3.0:1787432791.501229:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432791.501236:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432791.501261:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609520640:0@lo:400:kworker.0 00000100:00100000:0.0:1787432791.501265:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787432791.501286:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609520384:0@lo:400:kworker.0 00000100:00100000:3.0:1787432791.501294:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432791.501319:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609521152:0@lo:400:kworker.0 00000100:00100000:0.0:1787432791.501327:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432791.501354:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609520896:0@lo:400:kworker.0 00000100:00100000:0.0:1787432791.501378:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432791.501395:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609521408:0@lo:400:kworker.0 00000100:00100000:0.0:1787432791.501423:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609520256 00000100:00100000:0.0:1787432791.501430:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609520256 00000100:00100000:3.0:1787432791.501609:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432791.501645:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609521664:0@lo:400:kworker.0 00000100:00100000:1.0:1787432791.501646:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609520128 00000100:00100000:1.0:1787432791.501653:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609520128 00000100:00100000:3.0:1787432791.501678:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432791.501703:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787432791.501715:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787432791.501778:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609520512:0@lo:400:kworker.0 00000100:00100000:1.0:1787432791.501825:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609520128:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432791.501828:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787432791.501860:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787432791.501861:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609521024:0@lo:400:kworker.0 00000100:00100000:3.0:1787432791.501899:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432791.501918:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609520128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432791.501926:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609521536:0@lo:400:kworker.0 00000100:00100000:1.0:1787432791.501929:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787432791.501955:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432791.501964:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609521280 00000100:00100000:1.0:1787432791.501969:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609521280 00000100:00100000:1.0:1787432791.501991:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609520640 00000100:00100000:1.0:1787432791.501994:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609520640 00000100:00100000:1.0:1787432791.502005:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609521152 00000100:00100000:1.0:1787432791.502007:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609521152 00000100:00100000:1.0:1787432791.502017:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609521664 00000100:00100000:1.0:1787432791.502020:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609521664 00000100:00100000:1.0:1787432791.502031:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609521536 00000100:00100000:1.0:1787432791.502033:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609521536 00000100:00100000:1.0:1787432791.502048:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787432791.502054:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609521280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432791.502103:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609520768 00000100:00100000:1.0:1787432791.502108:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874258609521280:12345-0@lo:400:kworker.0 Request processed in 53us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432791.502109:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609520768 00000100:00100000:1.0:1787432791.502119:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787432791.502129:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787432791.502140:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609520256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432791.502145:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787432791.502146:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609520128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432791.502157:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609520640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432791.502200:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432791.502214:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609520256:12345-0@lo:400:kworker.0 Request processed in 76us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432791.502215:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609521792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787432791.502228:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787432791.502236:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874258609520640:12345-0@lo:400:kworker.0 Request processed in 82us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432791.502245:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787432791.502250:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787432791.502257:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432791.502264:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609520768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432791.502268:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787432791.502281:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609521152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432791.502355:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609520384 00000100:00100000:2.0:1787432791.502361:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609520384 00000100:00100000:3.0:1787432791.502373:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787432791.502373:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609520768:12345-0@lo:400:kworker.0 Request processed in 48us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432791.502383:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787432791.502387:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609520896 00000100:00100000:3.0:1787432791.502391:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609521664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432791.502393:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609520896 00000100:00100000:0.0:1787432791.502411:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609520512 00000100:00100000:0.0:1787432791.502417:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609520512 00000100:00100000:2.0:1787432791.502418:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609521024 00000100:00100000:2.0:1787432791.502423:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609521024 00000100:00100000:3.0:1787432791.502440:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874258609521664:12345-0@lo:400:kworker.0 Request processed in 54us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432791.502444:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787432791.502456:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787432791.502460:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609520384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432791.502476:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787432791.502478:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787432791.502495:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609520896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432791.502501:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609520384:12345-0@lo:400:kworker.0 Request processed in 43us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432791.502511:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787432791.502535:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787432791.502544:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948434f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609520512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432791.502564:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874258609520896:12345-0@lo:400:kworker.0 Request processed in 77us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432791.502573:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787432791.502580:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948434f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874258609520512:12345-0@lo:400:kworker.0 Request processed in 37us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432791.502589:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787432791.502595:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787432791.502604:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609521024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432791.502609:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609521536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432791.502648:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609521024:12345-0@lo:400:kworker.0 Request processed in 45us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432791.502656:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787432791.502662:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874258609521536:12345-0@lo:400:kworker.0 Request processed in 174us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432791.502670:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787432791.502696:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609521792 00000100:00100000:3.0:1787432791.502699:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609521792 00000100:00100000:3.0:1787432791.502793:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787432791.502814:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609521792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787432791.502827:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787432791.502872:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609521792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432791.502878:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787432791.502915:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432791.502924:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1874258609520512:0@lo:400:kworker.0 00000100:00100000:3.0:1787432791.502937:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609521024:0@lo:400:kworker.0 00000100:00100000:3.0:1787432791.502950:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1874258609521536:0@lo:400:kworker.0 00000100:00100000:0.0:1787432791.502957:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609520768:0@lo:400:kworker.0 00000100:00100000:3.0:1787432791.502961:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874258609520640:0@lo:400:kworker.0 00000100:00100000:0.0:1787432791.502980:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1874258609521280:0@lo:400:kworker.0 00000100:00100000:0.0:1787432791.502994:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609520256:0@lo:400:kworker.0 00000100:00100000:0.0:1787432791.503011:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609520384:0@lo:400:kworker.0 00000100:00100000:0.0:1787432791.503020:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9484348dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1874258609520896:0@lo:400:kworker.0 00000100:00100000:0.0:1787432791.503034:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609521408 00000100:00100000:0.0:1787432791.503037:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609521408 00000100:00100000:0.0:1787432791.503058:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787432791.503064:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609521408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432791.503075:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874258609521152:0@lo:400:kworker.0 00010000:00080000:3.0:1787432791.503098:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405503100 x1874258609521664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432791.503102:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874258609521408:12345-0@lo:400:kworker.0 Request processed in 36us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432791.503118:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787432791.503122:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1874258609521664:0@lo:400:kworker.0 00010000:00080000:0.0:1787432791.503154:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff948405501c00 x1874258609521408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432791.503405:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1874258609521408:0@lo:400:kworker.0 00000100:00080000:0.0:1787432791.504346:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787432791.504353:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787432791.504355:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787432791.504365:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432791.504611:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609521792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787432791.506335:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874258609521152:12345-0@lo:400:kworker.0 Request processed in 43us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432791.506351:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787432792.090392:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432792.094318:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588464896 00000100:00100000:2.0:1787432792.094338:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588464896 00000100:00100000:2.0:1787432792.094445:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 161 00000100:00100000:2.0:1787432792.094457:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+11:14951:x1874258588464896:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432792.094473:0:17148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432792.094503:0:17148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948301f05c00/0xca72b3b335640248 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5215 expref: -99 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432792.094532:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948301f05c00/0xca72b3b335640248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5215 expref: 12 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432792.094543:0:17148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948301f05c00/0xca72b3b335640248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5215 expref: 12 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432792.094551:0:17148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f05c00, rc 0) 00000100:00100000:2.0:1787432792.094622:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+12:14951:x1874258588464896:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 168us (4239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432792.094641:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 161 00000100:00100000:3.0:1787432792.098112:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432792.100437:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588465024 00000100:00100000:1.0:1787432792.100451:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588465024 00000100:00100000:3.0:1787432792.100589:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 162 00000100:00100000:3.0:1787432792.100600:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+12:14951:x1874258588465024:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432792.100748:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+12:14951:x1874258588465024:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 148us (2645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432792.100757:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 162 00000100:00100000:2.0:1787432792.109656:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432792.116585:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588465152 00000100:00100000:0.0:1787432792.116600:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588465152 00000100:00100000:0.0:1787432792.116669:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 163 00000100:00100000:0.0:1787432792.116679:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+12:14951:x1874258588465152:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432792.117098:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+12:14951:x1874258588465152:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 Request processed in 418us (7451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432792.117107:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 163 00000100:00100000:3.0:1787432792.122464:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432792.122553:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588465280 00000100:00100000:1.0:1787432792.122563:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588465280 00000100:00100000:1.0:1787432792.122617:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 164 00000100:00100000:1.0:1787432792.122628:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+12:14951:x1874258588465280:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432792.122643:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432792.122660:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff948302691600/0xca72b3b33564024f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d521c expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432792.122686:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff948302691600/0xca72b3b33564024f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d521c expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432792.122697:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff948302691600/0xca72b3b33564024f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d521c expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432792.122719:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302691600, rc 0) 00000100:00100000:1.0:1787432792.122782:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:14951:x1874258588465280:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 155us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432792.122800:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 164 00000100:00100000:0.0:1787432792.127364:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432792.127441:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588465408 00000100:00100000:3.0:1787432792.127452:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588465408 00000100:00100000:3.0:1787432792.127525:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 165 00000100:00100000:3.0:1787432792.127537:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:14951:x1874258588465408:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432792.127680:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:14951:x1874258588465408:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 145us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432792.127688:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 165 00000100:00100000:0.0:1787432792.133548:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432792.133676:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588465536 00000100:00100000:3.0:1787432792.133687:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588465536 00000100:00100000:3.0:1787432792.133748:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 166 00000100:00100000:3.0:1787432792.133758:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:14951:x1874258588465536:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432792.133920:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:14951:x1874258588465536:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 Request processed in 163us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432792.133928:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 166 00010000:00010000:2.0:1787432792.203453:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432792.523579:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609521920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432792.523654:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432792.523761:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609521920 00000100:00100000:1.0:1787432792.523768:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609521920 00000100:00100000:1.0:1787432792.523838:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787432792.523848:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609521920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432792.523876:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787432792.523929:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609521920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432792.523936:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787432792.524074:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609521920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432793.121286:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432793.121345:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432793.121372:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432793.121391:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432793.121407:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432793.121425:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432793.121439:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432793.121454:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432793.121479:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432793.121738:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588466176 00000100:00100000:2.0:1787432793.121752:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588466176 00000100:00100000:2.0:1787432793.121875:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588466688 00000100:00100000:2.0:1787432793.121879:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588466688 00000100:00100000:2.0:1787432793.121896:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588466048 00000100:00100000:2.0:1787432793.121899:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588466048 00000100:00100000:2.0:1787432793.121912:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588466560 00000100:00100000:2.0:1787432793.121914:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588466560 00000100:00100000:2.0:1787432793.121932:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:2.0:1787432793.121944:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588466176:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432793.122068:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588466176:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 124us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432793.122078:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:0.0:1787432793.122108:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588465920 00000100:00100000:2.0:1787432793.122120:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:0.0:1787432793.122128:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588465920 00000100:00100000:2.0:1787432793.122132:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2403:x1874258588466688:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432793.122207:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2403:x1874258588466688:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 78us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432793.122214:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:2.0:1787432793.122233:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:2.0:1787432793.123265:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588466048:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432793.123331:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588466048:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1089us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432793.123363:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:2.0:1787432793.123386:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:2.0:1787432793.123397:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2403:x1874258588466560:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432793.123424:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2403:x1874258588466560:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (1943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432793.123431:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:3.0:1787432793.124343:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588466432 00000100:00100000:3.0:1787432793.124358:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588466432 00000100:00100000:2.0:1787432793.124527:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588465792 00000100:00100000:2.0:1787432793.124532:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588465792 00000100:00100000:0.0:1787432793.129325:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588466304 00000100:00100000:0.0:1787432793.129345:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588466304 00000100:00100000:1.0:1787432793.129456:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588465664 00000100:00100000:1.0:1787432793.129461:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588465664 00000100:00100000:1.0:1787432793.129506:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 167 00000100:00100000:1.0:1787432793.129517:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:2403:x1874258588465664:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432793.129594:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:2403:x1874258588465664:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 79us (8325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432793.129602:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 167 00000100:00100000:1.0:1787432793.129651:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 59 00000100:00100000:1.0:1787432793.129661:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588465920:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432793.129694:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588465920:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 36us (8348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432793.129700:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 59 00000100:00100000:3.0:1787432793.136107:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 60 00000100:00100000:3.0:1787432793.136146:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2403:x1874258588466432:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787432793.136283:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2403:x1874258588466432:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 159us (14889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432793.136292:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 60 00000100:00080000:3.0:1787432793.136979:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432793.136988:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787432793.136992:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787432793.136996:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432793.141810:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 61 00000100:00100000:2.0:1787432793.141846:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+6:2403:x1874258588465792:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432793.141991:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+6:2403:x1874258588465792:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 166us (20564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432793.142001:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 61 00000100:00100000:0.0:1787432793.149541:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 62 00000100:00100000:0.0:1787432793.149568:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2403:x1874258588466304:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787432793.149677:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2403:x1874258588466304:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 123us (28220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432793.149689:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 62 00010000:00010000:3.0:1787432793.229337:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432793.547585:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609522048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787432793.547685:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432793.547934:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609522048 00000100:00100000:0.0:1787432793.547945:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609522048 00000100:00100000:0.0:1787432793.548014:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787432793.548026:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609522048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787432793.548073:0:17160:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787432793.548137:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609522048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432793.548185:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787432793.549136:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609522048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787432793.549941:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609522176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787432793.549979:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432793.549996:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609522304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787432793.559492:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432793.559858:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609522304 00000100:00100000:2.0:1787432793.559874:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609522304 00000100:00100000:2.0:1787432793.559984:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787432793.559998:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609522304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787432793.560037:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787432793.560113:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609522304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432793.560122:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787432793.564246:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432793.564403:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609522176 00000100:00100000:2.0:1787432793.564421:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609522176 00000100:00100000:2.0:1787432793.564497:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787432793.564508:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609522176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787432793.564544:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787432793.564611:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609522176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432793.564619:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787432793.565206:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609522176:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787432793.565660:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432793.565737:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609522304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787432793.951395:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432793.953699:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588466816 00000100:00100000:0.0:1787432793.953713:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588466816 00000100:00100000:0.0:1787432793.953875:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:0.0:1787432793.953887:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+6:15619:x1874258588466816:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432793.953909:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432793.953933:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b335640256 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5223 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.953999:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33564025d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954013:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33564025d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954027:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33564025d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954043:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640264 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954251:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954261:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954340:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33564026b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954367:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33564026b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954374:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33564026b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432793.954416:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787432793.954421:0:17155:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787432793.954463:0:17155:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33564026b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954473:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33564025d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954479:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33564025d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954688:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33564025d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954696:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432793.954700:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33564025d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954707:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33564025d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954719:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9483026f7400) 00010000:00010000:0.0:1787432793.954722:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432793.954726:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33564025d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954818:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b33564025d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954836:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954842:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640264 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954848:0:17155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640264 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954853:0:17155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432793.954860:0:17155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640264 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954866:0:17155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640264 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954874:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff948435964800) 00010000:00010000:0.0:1787432793.954876:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432793.954879:0:17155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640264 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954885:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640264 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954919:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b335640256 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5223 expref: 8 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954944:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948304488800/0xca72b3b33564026b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5223 expref: 7 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.954951:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff948435964600) 00010000:00010000:0.0:1787432793.954953:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787432793.954956:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948304488800, rc 0) 00000100:00100000:0.0:1787432793.955034:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+7:15619:x1874258588466816:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1145us (3645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432793.955042:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:3.0:1787432793.964204:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432793.964342:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588466944 00000100:00100000:0.0:1787432793.964353:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588466944 00000100:00100000:0.0:1787432793.964430:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 5 00000100:00100000:0.0:1787432793.964442:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:17ee1936-2707-48b4-a113-f80e95ac94b4+7:15619:x1874258588466944:12345-192.168.204.24@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787432793.964536:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:17ee1936-2707-48b4-a113-f80e95ac94b4+7:15619:x1874258588466944:12345-192.168.204.24@tcp:900:lhsmtool_posix.0 Request processed in 96us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432793.964545:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 5 00000100:00100000:1.0:1787432793.971668:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432793.975281:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588467200 00000100:00100000:0.0:1787432793.975302:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588467200 00000100:00100000:0.0:1787432793.975388:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:0.0:1787432793.975400:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+7:15619:x1874258588467200:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432793.975423:0:20092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432793.975458:0:20092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b335640272 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d522a expref: -99 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.975545:0:20092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640279 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.975580:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640279 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.975592:0:20092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640279 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.975654:0:20092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b335640280 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.975663:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b335640280 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.975670:0:20092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b335640280 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.980561:0:20092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd000/0xca72b3b335640287 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.980583:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd000/0xca72b3b335640287 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.980595:0:20092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd000/0xca72b3b335640287 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432793.980607:0:20092:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787432793.980778:0:20092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640279 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.980785:0:20092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640279 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.980791:0:20092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640279 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.980803:0:20092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432793.980807:0:20092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640279 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.980815:0:20092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640279 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.980828:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff948435964600) 00010000:00010000:0.0:1787432793.980830:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432793.980834:0:20092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640279 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.980841:0:20092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489000/0xca72b3b335640279 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.980856:0:20092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b335640280 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.980860:0:20092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b335640280 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.980865:0:20092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b335640280 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.980870:0:20092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948304489600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432793.980872:0:20092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b335640280 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.980877:0:20092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b335640280 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.980894:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff948435964800) 00010000:00010000:0.0:1787432793.980897:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432793.980899:0:20092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b335640280 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.980904:0:20092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304489600/0xca72b3b335640280 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.984902:0:20092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948304488400/0xca72b3b335640272 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d522a expref: 10 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.985552:0:20092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd000/0xca72b3b335640287 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d522a expref: 9 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432793.985563:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948435964e00) 00010000:00010000:0.0:1787432793.985566:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432793.985569:0:20092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fd000, rc 0) 00000100:00100000:0.0:1787432793.985647:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+9:15619:x1874258588467200:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 10248us (13989us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787432793.985656:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:3.0:1787432794.008221:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432794.008601:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588467328 00000100:00100000:0.0:1787432794.008611:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588467328 00000100:00100000:0.0:1787432794.008679:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:0.0:1787432794.008690:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+9:15619:x1874258588467328:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787432794.008817:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+9:15619:x1874258588467328:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 128us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432794.008827:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:3.0:1787432794.025336:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432794.025593:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588467456 00000100:00100000:1.0:1787432794.025603:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588467456 00000100:00100000:1.0:1787432794.025676:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 26 00000100:00100000:1.0:1787432794.025688:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+5:15619:x1874258588467456:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1787432794.028291:0:17154:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2553us 00000100:00100000:1.0:1787432794.038813:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432794.042414:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588467584 00000100:00100000:0.0:1787432794.042434:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588467584 00000100:00100000:0.0:1787432794.042522:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 27 00000100:00100000:0.0:1787432794.042533:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+9:15625:x1874258588467584:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787432794.042557:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432794.042578:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b335640295 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5231 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042654:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b33564029c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042679:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b33564029c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042691:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b33564029c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042715:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fcc00/0xca72b3b3356402a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042724:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fcc00/0xca72b3b3356402a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042731:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fcc00/0xca72b3b3356402a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042786:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b33564029c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042795:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b33564029c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042819:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b33564029c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042825:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fd400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432794.042830:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b33564029c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042838:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b33564029c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042850:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9483026f7400) 00010000:00010000:0.0:1787432794.042854:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432794.042858:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b33564029c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042864:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b33564029c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042880:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fcc00/0xca72b3b3356402a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042886:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fcc00/0xca72b3b3356402a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042892:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fcc00/0xca72b3b3356402a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042897:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fcc00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432794.042900:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fcc00/0xca72b3b3356402a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042914:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fcc00/0xca72b3b3356402a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042922:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff948435964800) 00010000:00010000:0.0:1787432794.042925:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432794.042928:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fcc00/0xca72b3b3356402a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042933:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fcc00/0xca72b3b3356402a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042966:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b335640295 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5231 expref: 10 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.042976:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9483026f7400) 00010000:00010000:0.0:1787432794.042979:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432794.042982:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b335640295 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5231 expref: 10 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.043004:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fc000, rc 0) 00000100:00100000:0.0:1787432794.043085:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+9:15625:x1874258588467584:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 553us (4636us total) trans 0 rc 301/301 00000100:00100000:0.0:1787432794.043095:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 27 00000100:00100000:3.0:1787432794.046869:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432794.047197:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588467712 00000100:00100000:2.0:1787432794.047207:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588467712 00000100:00100000:2.0:1787432794.047260:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:2.0:1787432794.047269:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:17ee1936-2707-48b4-a113-f80e95ac94b4+9:15625:x1874258588467712:12345-192.168.204.24@tcp:700:lfs.0 00000100:00100000:2.0:1787432794.047357:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:17ee1936-2707-48b4-a113-f80e95ac94b4+9:15625:x1874258588467712:12345-192.168.204.24@tcp:700:lfs.0 Request processed in 88us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432794.047364:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:3.0:1787432794.057216:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+5:15619:x1874258588467456:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 31519us (31882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432794.057231:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 26 00000100:00100000:1.0:1787432794.057618:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432794.060080:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588467968 00000100:00100000:0.0:1787432794.060094:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588467968 00000100:00100000:0.0:1787432794.060203:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 28 00000100:00100000:0.0:1787432794.060216:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+9:15625:x1874258588467968:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:0.0:1787432794.060291:0:20092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432794.060319:0:20092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356401c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d519e expref: 9 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.060340:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9483026f7400) 00010000:00010000:0.0:1787432794.060345:0:20092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432794.060402:0:20092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b3356402aa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.060417:0:20092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b335640202 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d520e expref: 5 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.060425:0:20092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b3356402aa lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.060474:0:20092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b335640202 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d520e expref: 5 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432794.060488:0:20092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b335640202 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d520e expref: 5 pid: 17154 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432794.060501:0:20092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9483039a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20092:1874258609522432:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787432794.061330:0:20092:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301e0bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432794.065772:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432794.066030:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588468096 00000100:00100000:1.0:1787432794.066039:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588468096 00010000:00010000:1.0:1787432794.066077:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b335640202 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d520e expref: 6 pid: 17154 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432794.066115:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00100000:1.0:1787432794.066125:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304569500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2402:x1874258588468096:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432794.066139:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432794.066145:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b335640202 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d520e expref: 6 pid: 17154 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432794.066158:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b335640202 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d520e expref: 6 pid: 17154 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432794.066211:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9483026f7400) 00010000:00010000:1.0:1787432794.066227:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b3356402aa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432794.066237:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b3356402aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432794.066244:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b3356402aa lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432794.066262:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432794.066315:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304569500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2402:x1874258588468096:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 191us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432794.066322:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 15 00010000:00010000:0.0:1787432794.070390:0:20092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b335640202 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d520e expref: 5 pid: 17154 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432794.070423:0:20092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9483039a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20092:1874258609522432:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432794.070800:0:20092:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b3356402aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.072518:0:20092:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b3356402aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.072535:0:20092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b3356402aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.073840:0:20092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05800/0xca72b3b3356402b1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.073861:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05800/0xca72b3b3356402b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.073875:0:20092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05800/0xca72b3b3356402b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.076507:0:20092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05200/0xca72b3b3356402b8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.076532:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05200/0xca72b3b3356402b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.076545:0:20092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05200/0xca72b3b3356402b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432794.076570:0:20092:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000072590c40 reply state 00000000199be128 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05200/0xca72b3b3356402b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.076582:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05200/0xca72b3b3356402b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.076590:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948418e86200) 00010000:00010000:2.0:1787432794.076593:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787432794.076598:0:20092:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787432794.076604:0:20092:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787432794.076612:0:20092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b3356402aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.076620:0:20092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b3356402aa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.076627:0:20092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b3356402aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.076633:0:20092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fc000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432794.076637:0:20092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b3356402aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.076658:0:20092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b3356402aa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.076671:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9483026f7400) 00010000:00010000:2.0:1787432794.076674:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432794.076678:0:20092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b3356402aa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.076683:0:20092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b3356402aa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432794.076856:0:20092:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000072590c40 reply state 00000000199be128 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05800/0xca72b3b3356402b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.076867:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05800/0xca72b3b3356402b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.076873:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff948418e86d00) 00010000:00010000:2.0:1787432794.076875:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787432794.076877:0:20092:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787432794.076981:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+10:15625:x1874258588467968:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 16764us (19359us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787432794.076990:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 28 00010000:00010000:3.0:1787432794.257575:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432794.260943:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432794.261041:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588468224 00000100:00100000:3.0:1787432794.261051:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588468224 00000100:00100000:3.0:1787432794.261115:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 29 00000100:00100000:3.0:1787432794.261127:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+10:15633:x1874258588468224:12345-192.168.204.24@tcp:101:lctl.0 00010000:00010000:3.0:1787432794.261152:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432794.261202:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356402bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5238 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.261282:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b3356402c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.261296:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b3356402c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.261307:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b3356402c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432794.261350:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787432794.261354:0:17155:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787432794.261392:0:17155:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b3356402c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.261416:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356402bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5238 expref: 12 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.261434:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fc00/0xca72b3b3356402c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5238 expref: 11 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.261644:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435957900) 00010000:00010000:3.0:1787432794.261647:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432794.261651:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85fc00, rc 0) 00000100:00100000:3.0:1787432794.261792:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+11:15633:x1874258588468224:12345-192.168.204.24@tcp:101:lctl.0 Request processed in 666us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432794.261800:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 29 00000100:00100000:0.0:1787432794.325020:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432794.325236:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588468352 00000100:00100000:3.0:1787432794.325251:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588468352 00000100:00100000:3.0:1787432794.325336:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 30 00000100:00100000:3.0:1787432794.325348:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:15634:x1874258588468352:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432794.325368:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432794.325389:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356402cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d523f expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.325480:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b3356402d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.325496:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b3356402d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.325510:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b3356402d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432794.325560:0:17156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787432794.325563:0:17156:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787432794.325583:0:17156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b3356402d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.325609:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356402cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d523f expref: 7 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.325629:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ea00/0xca72b3b3356402d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d523f expref: 6 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.325637:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435957900) 00010000:00010000:3.0:1787432794.325640:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432794.325643:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85ea00, rc 0) 00000100:00100000:3.0:1787432794.325718:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:15634:x1874258588468352:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 371us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432794.325732:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 30 00000100:00100000:1.0:1787432794.333960:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432794.334054:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588468480 00000100:00100000:3.0:1787432794.334064:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588468480 00000100:00100000:3.0:1787432794.334131:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 31 00000100:00100000:3.0:1787432794.334142:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:15634:x1874258588468480:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432794.334201:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432794.334231:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356402db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5246 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334311:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b3356402e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334326:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b3356402e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334337:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b3356402e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334347:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356402e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334354:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356402e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334359:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356402e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334458:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b3356402f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334486:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b3356402f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334494:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b3356402f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432794.334540:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787432794.334544:0:17154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787432794.334564:0:17154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b3356402f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334575:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b3356402e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334581:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b3356402e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334587:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b3356402e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334593:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432794.334598:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b3356402e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334604:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b3356402e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334617:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435957900) 00010000:00010000:3.0:1787432794.334620:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432794.334625:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b3356402e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334640:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b3356402e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334655:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356402e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334661:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356402e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334667:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356402e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334671:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ee00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432794.334674:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356402e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334679:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356402e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334686:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff948418e86d00) 00010000:00010000:3.0:1787432794.334688:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432794.334691:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356402e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334702:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356402e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334727:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356402db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5246 expref: 8 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334765:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b3356402f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5246 expref: 7 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.334773:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948418e86200) 00010000:00010000:3.0:1787432794.334775:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432794.334777:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85fe00, rc 0) 00000100:00100000:3.0:1787432794.334835:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+7:15634:x1874258588468480:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 695us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432794.334843:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 31 00000100:00100000:0.0:1787432794.345087:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432794.345202:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588468608 00000100:00100000:3.0:1787432794.345213:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588468608 00000100:00100000:3.0:1787432794.345279:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 6 00000100:00100000:3.0:1787432794.345291:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:15634:x1874258588468608:12345-192.168.204.24@tcp:900:lfs.0 00000100:00100000:3.0:1787432794.345385:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:15634:x1874258588468608:12345-192.168.204.24@tcp:900:lfs.0 Request processed in 96us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432794.345393:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 6 00000100:00100000:0.0:1787432794.360726:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432794.360879:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588468864 00000100:00100000:3.0:1787432794.360890:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588468864 00000100:00100000:3.0:1787432794.360953:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 32 00000100:00100000:3.0:1787432794.360964:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+7:15634:x1874258588468864:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432794.360996:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432794.361021:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356402f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d524d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432794.361144:0:17156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787432794.361315:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356402f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d524d expref: 9 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.361332:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435957900) 00010000:00010000:3.0:1787432794.361336:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432794.361341:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356402f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d524d expref: 9 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.361358:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e200, rc 0) 00000100:00100000:3.0:1787432794.361429:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+8:15634:x1874258588468864:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 468us (714us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787432794.361508:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 32 00000100:00100000:1.0:1787432794.372476:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432794.372570:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588469120 00000100:00100000:3.0:1787432794.372583:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588469120 00000100:00100000:3.0:1787432794.372664:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 33 00000100:00100000:3.0:1787432794.372677:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+8:15634:x1874258588469120:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:3.0:1787432794.372769:0:17154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432794.372801:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b3356402f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5246 expref: 8 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.372822:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948418e86200) 00010000:00010000:3.0:1787432794.372827:0:17154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432794.372850:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b335640305 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.372864:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b335640305 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.372873:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b335640305 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432794.373118:0:17154:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043a3fd9f reply state 0000000032cbf650 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b335640305 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.373131:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b335640305 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.373137:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948418e86200) 00010000:00010000:3.0:1787432794.373139:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1787432794.373142:0:17154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787432794.373149:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787432794.373283:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+9:15634:x1874258588469120:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 607us (819us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787432794.373290:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 33 00000100:00100000:0.0:1787432794.379074:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432794.382893:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588469376 00000100:00100000:2.0:1787432794.382909:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588469376 00000100:00100000:2.0:1787432794.382998:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 2 00000100:00100000:2.0:1787432794.383010:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+9:15634:x1874258588469376:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:2.0:1787432794.383754:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+10:15634:x1874258588469376:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 733us (4680us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787432794.383779:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 2 00000100:00100000:0.0:1787432794.391368:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432794.391466:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588469632 00000100:00100000:3.0:1787432794.391478:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588469632 00000100:00100000:3.0:1787432794.391550:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 34 00000100:00100000:3.0:1787432794.391564:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+10:15634:x1874258588469632:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432794.391594:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432794.391620:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33564030c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5254 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.391828:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640313 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.391843:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640313 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.391854:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640313 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.391884:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564031a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.391892:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564031a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.391898:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564031a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432794.392038:0:17156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787432794.392124:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640313 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.392132:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640313 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.392139:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640313 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.392145:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ee00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432794.392149:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640313 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.392156:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640313 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.392215:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435957900) 00010000:00010000:3.0:1787432794.392219:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432794.392223:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640313 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.392241:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640313 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.392258:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564031a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.392264:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564031a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.392270:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564031a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.392275:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432794.392278:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564031a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.392285:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564031a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.392293:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff948418e86d00) 00010000:00010000:3.0:1787432794.392295:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432794.392298:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564031a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.392303:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564031a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.392336:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33564030c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5254 expref: 12 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.392359:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435957900) 00010000:00010000:3.0:1787432794.392361:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432794.392365:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33564030c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5254 expref: 12 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.392375:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85fe00, rc 0) 00000100:00100000:3.0:1787432794.392434:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+11:15634:x1874258588469632:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 873us (1077us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787432794.394285:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 34 00000100:00100000:1.0:1787432794.400394:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432794.400543:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588469760 00000100:00100000:3.0:1787432794.400554:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588469760 00000100:00100000:3.0:1787432794.400629:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 35 00000100:00100000:3.0:1787432794.400640:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+11:15634:x1874258588469760:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787432794.400664:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432794.400685:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b335640328 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d525b expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.400797:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564032f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.400811:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564032f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.400823:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564032f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432794.400848:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787432794.400865:0:17154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787432794.400887:0:17154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564032f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.400914:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b335640328 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d525b expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.400934:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564032f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d525b expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.400944:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948418e86200) 00010000:00010000:3.0:1787432794.400947:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432794.400951:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85e400, rc 0) 00000100:00100000:3.0:1787432794.401026:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+12:15634:x1874258588469760:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 387us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432794.401033:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 35 00000100:00100000:0.0:1787432794.407127:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432794.407247:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588469888 00000100:00100000:1.0:1787432794.407258:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588469888 00000100:00100000:1.0:1787432794.407313:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:1.0:1787432794.407324:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+12:15634:x1874258588469888:12345-192.168.204.24@tcp:37:lfs.0 00000100:00100000:1.0:1787432794.416382:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fd65f33-d046-43bb-9119-74a1dce1ebb4+12:15634:x1874258588469888:12345-192.168.204.24@tcp:37:lfs.0 Request processed in 9047us (9252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432794.416861:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:3.0:1787432794.427399:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432794.427548:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588470144 00000100:00100000:2.0:1787432794.427559:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588470144 00000100:00100000:2.0:1787432794.427620:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 4 00000100:00100000:2.0:1787432794.427630:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483030bf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+12:15634:x1874258588470144:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:2.0:1787432794.427870:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483030bf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+13:15634:x1874258588470144:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 239us (480us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787432794.427878:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 4 00000100:00100000:0.0:1787432794.543129:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432794.543260:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588470272 00000100:00100000:2.0:1787432794.543271:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588470272 00000100:00100000:2.0:1787432794.543337:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 36 00000100:00100000:2.0:1787432794.543348:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+11:15640:x1874258588470272:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787432794.543368:0:20092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432794.543391:0:20092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640336 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5262 expref: -99 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543468:0:20092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564033d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543483:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564033d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543494:0:20092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564033d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543506:0:20092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b335640344 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543533:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b335640344 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543540:0:20092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b335640344 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543619:0:20092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04800/0xca72b3b33564034b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543629:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04800/0xca72b3b33564034b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543637:0:20092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04800/0xca72b3b33564034b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432794.543670:0:20092:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787432794.543674:0:20092:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787432794.543714:0:20092:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04800/0xca72b3b33564034b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543726:0:20092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564033d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543733:0:20092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564033d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543749:0:20092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564033d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543755:0:20092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f04600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432794.543759:0:20092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564033d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543773:0:20092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564033d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543786:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435957900) 00010000:00010000:2.0:1787432794.543789:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432794.543794:0:20092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564033d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543799:0:20092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564033d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543812:0:20092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b335640344 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543818:0:20092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b335640344 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543824:0:20092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b335640344 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543830:0:20092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f04e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432794.543832:0:20092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b335640344 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543838:0:20092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b335640344 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543845:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff948418e86d00) 00010000:00010000:2.0:1787432794.543847:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432794.543850:0:20092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b335640344 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543866:0:20092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b335640344 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543893:0:20092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04200/0xca72b3b335640336 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5262 expref: 13 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543906:0:20092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04800/0xca72b3b33564034b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5262 expref: 12 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.543913:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948418e86200) 00010000:00010000:2.0:1787432794.543915:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787432794.543918:0:20092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f04800, rc 0) 00000100:00100000:2.0:1787432794.543988:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+12:15640:x1874258588470272:12345-192.168.204.24@tcp:101:bash.0 Request processed in 642us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432794.543996:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 36 00000100:00100000:0.0:1787432794.547076:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432794.547248:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588470400 00000100:00100000:3.0:1787432794.547258:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588470400 00000100:00100000:3.0:1787432794.547319:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:3.0:1787432794.547330:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:17ee1936-2707-48b4-a113-f80e95ac94b4+5:15640:x1874258588470400:12345-192.168.204.24@tcp:900:bash.0 00000100:00100000:3.0:1787432794.547416:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:17ee1936-2707-48b4-a113-f80e95ac94b4+5:15640:x1874258588470400:12345-192.168.204.24@tcp:900:bash.0 Request processed in 87us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432794.547425:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:1.0:1787432794.550801:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432794.551354:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588470656 00000100:00100000:3.0:1787432794.551367:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588470656 00000100:00100000:3.0:1787432794.551476:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 37 00000100:00100000:3.0:1787432794.551487:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+12:15640:x1874258588470656:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787432794.551521:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432794.551543:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b335640352 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5269 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.551667:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640359 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.551684:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564032f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d525b expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.551694:0:17154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640359 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.551729:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564032f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d525b expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.551755:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564032f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d525b expref: 12 pid: 17154 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432794.551770:0:17154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303adb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17154:1874258609522560:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787432794.551857:0:17154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484210f3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432794.555239:0:17154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303adb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17154:1874258609522560:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787432794.555275:0:17154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640359 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432794.556002:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432794.556391:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588470784 00000100:00100000:2.0:1787432794.556399:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588470784 00010000:00010000:2.0:1787432794.556449:0:17141:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564032f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d525b expref: 13 pid: 17154 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432794.556494:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:2.0:1787432794.556505:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+13:2402:x1874258588470784:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432794.556521:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432794.556528:0:17141:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564032f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d525b expref: 13 pid: 17154 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.556560:0:17141:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564032f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d525b expref: 13 pid: 17154 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.556585:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e400/0xca72b3b33564032f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d525b expref: 13 pid: 17154 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.556603:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948418e86200) 00010000:00010000:2.0:1787432794.556608:0:17141:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640359 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.556619:0:17141:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640359 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.556627:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640359 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.556651:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432794.556711:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+12:2402:x1874258588470784:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 207us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432794.556719:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 16 00010000:00010000:3.0:1787432794.557208:0:17154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640359 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.557218:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640359 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.557252:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e000/0xca72b3b335640360 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.557264:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e000/0xca72b3b335640360 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.557273:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e000/0xca72b3b335640360 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.557726:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640367 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.557737:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640367 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.557754:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640367 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432794.557764:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787432794.557788:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640359 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.557795:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640359 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.557802:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640359 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.557808:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ee00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432794.557813:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640359 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.557832:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640359 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.557844:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948418e86200) 00010000:00010000:3.0:1787432794.557847:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432794.557851:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640359 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.557857:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b335640359 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432794.557867:0:17154:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005c02c91 reply state 00000000a751f912 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e000/0xca72b3b335640360 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.557877:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e000/0xca72b3b335640360 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.557883:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff948435957400) 00010000:00010000:3.0:1787432794.557885:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787432794.557888:0:17154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787432794.557924:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b335640352 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5269 expref: 15 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.557938:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640367 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5269 expref: 14 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.557944:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:3.0:1787432794.557946:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787432794.557948:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85f600, rc 0) 00000100:00100000:3.0:1787432794.558005:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+15:15640:x1874258588470656:12345-192.168.204.24@tcp:101:bash.0 Request processed in 6519us (7214us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787432794.558012:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 37 00000100:00100000:1.0:1787432794.570080:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432794.570213:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588470912 00000100:00100000:2.0:1787432794.570224:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588470912 00000100:00100000:2.0:1787432794.570288:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 38 00000100:00100000:2.0:1787432794.570300:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+15:15640:x1874258588470912:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787432794.570327:0:20092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432794.570350:0:20092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b335640375 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5270 expref: -99 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.570452:0:20092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564037c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.570467:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564037c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.570479:0:20092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564037c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432794.570530:0:20092:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787432794.570535:0:20092:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787432794.570553:0:20092:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564037c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.570564:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564037c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.570589:0:20092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b335640375 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5270 expref: 17 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.570607:0:20092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564037c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5270 expref: 16 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.570616:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:2.0:1787432794.570619:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432794.570623:0:20092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f04600, rc 0) 00000100:00100000:2.0:1787432794.570686:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+16:15640:x1874258588470912:12345-192.168.204.24@tcp:101:bash.0 Request processed in 388us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432794.570694:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 38 00000100:00100000:2.0:1787432794.574432:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432794.574566:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588471168 00000100:00100000:1.0:1787432794.574576:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588471168 00000100:00100000:1.0:1787432794.574634:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 5 00000100:00100000:1.0:1787432794.574661:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+16:15640:x1874258588471168:12345-192.168.204.24@tcp:35:bash.0 00000100:00100000:1.0:1787432794.574973:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+17:15640:x1874258588471168:12345-192.168.204.24@tcp:35:bash.0 Request processed in 314us (549us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787432794.574982:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 5 00000100:00100000:0.0:1787432794.685588:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432794.685848:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588471424 00000100:00100000:2.0:1787432794.685860:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588471424 00000100:00100000:2.0:1787432794.685966:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 39 00000100:00100000:2.0:1787432794.685988:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+17:15650:x1874258588471424:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432794.686016:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432794.686047:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b335640383 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5277 expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432794.686145:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787432794.686274:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b335640383 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5277 expref: 19 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.686291:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff948435957900) 00010000:00010000:2.0:1787432794.686294:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787432794.686299:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b335640383 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5277 expref: 19 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.686314:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f04e00, rc 0) 00000100:00100000:2.0:1787432794.686426:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+18:15650:x1874258588471424:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 441us (849us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787432794.686443:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 39 00000100:00100000:3.0:1787432794.690080:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432794.690590:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588471680 00000100:00100000:1.0:1787432794.690601:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588471680 00000100:00100000:1.0:1787432794.690702:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 6 00000100:00100000:1.0:1787432794.690714:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+18:15650:x1874258588471680:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:1.0:1787432794.690982:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+19:15650:x1874258588471680:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 261us (901us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787432794.690991:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 6 00000040:00080000:3.0:1787432794.703805:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787432794.704699:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787432794.757102:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432794.757223:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588471936 00000100:00100000:2.0:1787432794.757233:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588471936 00000100:00100000:2.0:1787432794.757294:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 40 00000100:00100000:2.0:1787432794.757305:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+19:15653:x1874258588471936:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787432794.757450:0:20092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432794.757484:0:20092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b335640391 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d527e expref: -99 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.757591:0:20092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640398 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.757606:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640398 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.757617:0:20092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640398 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432794.757628:0:20092:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787432794.758125:0:20092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b335640391 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d527e expref: 22 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.758146:0:20092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640398 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d527e expref: 21 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432794.758155:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:2.0:1787432794.758158:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432794.758161:0:20092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f05600, rc 0) 00000100:00100000:2.0:1787432794.758360:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+21:15653:x1874258588471936:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1056us (1267us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787432794.758369:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 40 00000100:00100000:0.0:1787432794.767611:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432794.767849:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588472064 00000100:00100000:3.0:1787432794.767859:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588472064 00000100:00100000:3.0:1787432794.767922:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 41 00000100:00100000:3.0:1787432794.767933:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+21:15653:x1874258588472064:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:3.0:1787432794.768010:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b3356403a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.770636:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b3356403a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.770665:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b3356403a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.770728:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b3356403a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.770745:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b3356403a6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.770752:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b3356403a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.770757:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85fe00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432794.770761:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b3356403a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.770788:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b3356403a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.770802:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:3.0:1787432794.770805:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432794.770811:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b3356403a6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.770817:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b3356403a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432794.771144:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+21:15653:x1874258588472064:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 3208us (3537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432794.771154:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 41 00000100:00100000:0.0:1787432794.771364:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432794.772527:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588472192 00000100:00100000:3.0:1787432794.772539:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588472192 00000100:00100000:3.0:1787432794.772603:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:3.0:1787432794.772612:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+21:2400:x1874258588472192:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432794.772626:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432794.772656:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640398 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d527e expref: 21 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432794.772672:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:3.0:1787432794.772676:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432794.772718:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+20:2400:x1874258588472192:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 107us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432794.772725:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:1.0:1787432794.776244:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432794.776377:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588472448 00000100:00100000:2.0:1787432794.776387:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588472448 00000100:00100000:2.0:1787432794.776454:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:2.0:1787432794.776466:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+20:15653:x1874258588472448:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:2.0:1787432794.776916:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+21:15653:x1874258588472448:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 451us (681us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787432794.776925:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:0.0:1787432795.143935:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432795.144102:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588472704 00000100:00100000:3.0:1787432795.144113:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588472704 00000100:00100000:3.0:1787432795.144313:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 42 00000100:00100000:3.0:1787432795.144326:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483039a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+21:15684:x1874258588472704:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:3.0:1787432795.144351:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432795.144371:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b3356403ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5285 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.144489:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356403b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.144503:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356403b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.144517:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356403b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432795.144529:0:17156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787432795.144645:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b3356403ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5285 expref: 24 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.144666:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356403b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5285 expref: 23 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.144674:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:3.0:1787432795.144867:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432795.144882:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85ee00, rc 0) 00000100:00100000:3.0:1787432795.144950:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483039a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+23:15684:x1874258588472704:12345-192.168.204.24@tcp:101:cat.0 Request processed in 626us (1024us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1787432795.144976:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 42 00000100:00080000:0.0:1787432795.145817:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432795.149822:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432795.149914:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432795.150017:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588473088 00000100:00100000:2.0:1787432795.150035:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588473088 00000100:00100000:2.0:1787432795.150099:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:2.0:1787432795.150110:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+23:15684:x1874258588473088:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:2.0:1787432795.150541:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+24:15684:x1874258588473088:12345-192.168.204.24@tcp:35:cat.0 Request processed in 431us (727us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787432795.150549:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:3.0:1787432795.156254:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588472832 00000100:00100000:3.0:1787432795.156268:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588472832 00000100:00100000:3.0:1787432795.156370:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1 00000100:00100000:3.0:1787432795.156381:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+24:2402:x1874258588472832:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432795.156396:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432795.156420:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356403b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5285 expref: 24 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.156619:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:3.0:1787432795.156623:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432795.156695:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+23:2402:x1874258588472832:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 316us (6781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432795.156703:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1 00000100:00100000:0.0:1787432795.228291:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432795.228592:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588473344 00000100:00100000:2.0:1787432795.228602:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588473344 00000100:00100000:2.0:1787432795.228684:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 43 00000100:00100000:2.0:1787432795.228696:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9484348dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+23:15690:x1874258588473344:12345-192.168.204.24@tcp:101:dd.0 00010000:00010000:2.0:1787432795.228720:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432795.228749:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b3356403c2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d528c expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.228853:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b3356403c9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.228868:0:17155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640367 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5269 expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.228877:0:17155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564037c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5270 expref: 24 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.228903:0:17155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b3356403c9 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.228938:0:17155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564037c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5270 expref: 24 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.228952:0:17155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564037c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5270 expref: 24 pid: 20092 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432795.228967:0:17155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17155:1874258609522688:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432795.229074:0:17155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640367 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5269 expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.229084:0:17155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640367 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5269 expref: 24 pid: 17154 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432795.229093:0:17155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17155:1874258609522816:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432795.229117:0:17155:0:(client.c:2715:ptlrpc_set_wait()) set ffff94830316b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787432795.233823:0:17155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17155:1874258609522688:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787432795.235220:0:17155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17155:1874258609522816:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432795.235251:0:17155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b3356403c9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432795.237566:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432795.238432:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588473472 00000100:00100000:3.0:1787432795.238444:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588473472 00010000:00010000:3.0:1787432795.238489:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564037c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5270 expref: 25 pid: 20092 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432795.238536:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:3.0:1787432795.238547:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+25:2403:x1874258588473472:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432795.238562:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432795.238569:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564037c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5270 expref: 25 pid: 20092 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.238584:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564037c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5270 expref: 25 pid: 20092 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.238622:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564037c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5270 expref: 25 pid: 20092 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.238837:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:3.0:1787432795.238844:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b3356403c9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.238853:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b3356403c9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.238860:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432795.238971:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+24:2403:x1874258588473472:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 424us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432795.238980:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:1.0:1787432795.242386:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432795.242568:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588473600 00000100:00100000:2.0:1787432795.242578:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588473600 00010000:00010000:2.0:1787432795.242633:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640367 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5269 expref: 24 pid: 17154 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432795.242684:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00100000:2.0:1787432795.242695:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843376dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+24:2403:x1874258588473600:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432795.242707:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432795.242714:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640367 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5269 expref: 24 pid: 17154 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.242740:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640367 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5269 expref: 24 pid: 17154 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.242763:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f600/0xca72b3b335640367 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5269 expref: 24 pid: 17154 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.242781:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:2.0:1787432795.242787:0:17140:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b3356403c9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.242797:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b3356403c9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.242805:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b3356403c9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.242838:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432795.242889:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843376dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+23:2403:x1874258588473600:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 195us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432795.242898:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 18 00010000:00010000:1.0:1787432795.243426:0:17155:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b3356403c9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.243437:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b3356403c9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432795.243457:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787432795.243595:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b3356403c2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d528c expref: 24 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.243614:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05a00/0xca72b3b3356403c9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d528c expref: 23 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.243635:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:1.0:1787432795.243638:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787432795.243640:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f05a00, rc 0) 00000100:00100000:1.0:1787432795.243671:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9484348dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+23:15690:x1874258588473344:12345-192.168.204.24@tcp:101:dd.0 Request processed in 14978us (15392us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787432795.243691:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 43 00000100:00100000:1.0:1787432795.250536:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432795.250621:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588473728 00000100:00100000:2.0:1787432795.250631:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588473728 00000100:00100000:2.0:1787432795.250703:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 44 00000100:00100000:2.0:1787432795.250714:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+23:15690:x1874258588473728:12345-192.168.204.24@tcp:101:dd.0 00010000:00010000:2.0:1787432795.250748:0:20092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432795.250770:0:20092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04000/0xca72b3b3356403d7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d5293 expref: -99 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.250806:0:20092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04a00/0xca72b3b3356403de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.250821:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04a00/0xca72b3b3356403de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.250833:0:20092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04a00/0xca72b3b3356403de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.250951:0:20092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04000/0xca72b3b3356403d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5293 expref: 25 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.250969:0:20092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04a00/0xca72b3b3356403de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5293 expref: 24 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.250979:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:2.0:1787432795.250982:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787432795.250985:0:20092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f04a00, rc 0) 00000100:00100000:2.0:1787432795.251055:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+24:15690:x1874258588473728:12345-192.168.204.24@tcp:101:dd.0 Request processed in 342us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432795.251062:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 44 00000100:00100000:0.0:1787432795.255259:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432795.255615:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588473984 00000100:00100000:3.0:1787432795.255625:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588473984 00000100:00100000:3.0:1787432795.255741:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 45 00000100:00100000:3.0:1787432795.255753:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+24:15690:x1874258588473984:12345-192.168.204.24@tcp:36:dd.0 00010000:00010000:3.0:1787432795.255969:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356403e5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.255986:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356403e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.255998:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356403e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787432795.256059:0:17154:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1787432795.256104:0:17154:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043179586 reply state 00000000f0dd4bb4 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356403e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.256117:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356403e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.256125:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:3.0:1787432795.256127:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787432795.256131:0:17154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787432795.256273:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+27:15690:x1874258588473984:12345-192.168.204.24@tcp:36:dd.0 Request processed in 522us (1024us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1787432795.256282:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 45 00000020:00080000:3.0:1787432795.256286:0:17154:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787432795.259605:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432795.259767:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588474112 00000100:00100000:2.0:1787432795.259775:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588474112 00000100:00100000:2.0:1787432795.259864:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 46 00000100:00100000:2.0:1787432795.259875:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+27:15690:x1874258588474112:12345-192.168.204.24@tcp:101:dd.0 00010000:00010000:2.0:1787432795.259898:0:20092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432795.259917:0:20092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04c00/0xca72b3b3356403ec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d529a expref: -99 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.259980:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04c00/0xca72b3b3356403ec lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d529a expref: 28 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.259994:0:20092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04c00/0xca72b3b3356403ec lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d529a expref: 28 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.260020:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:2.0:1787432795.260024:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787432795.260028:0:20092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f04c00, rc 0) 00000100:00100000:2.0:1787432795.260085:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+28:15690:x1874258588474112:12345-192.168.204.24@tcp:101:dd.0 Request processed in 212us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432795.260092:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 46 00000100:00100000:2.0:1787432795.273630:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432795.273795:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588474368 00000100:00100000:0.0:1787432795.273805:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588474368 00000100:00100000:0.0:1787432795.273873:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 2 00000100:00100000:0.0:1787432795.273885:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+28:15690:x1874258588474368:12345-192.168.204.24@tcp:103:dd.0 00010000:00010000:0.0:1787432795.273900:0:18685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432795.273927:0:18685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04c00/0xca72b3b3356403ec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d529a expref: 28 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.273962:0:18685:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:0.0:1787432795.273967:0:18685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432795.274037:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+27:15690:x1874258588474368:12345-192.168.204.24@tcp:103:dd.0 Request processed in 154us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432795.274044:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 2 00010000:00010000:2.0:1787432795.275522:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432795.277147:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432795.277348:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588474496 00000100:00100000:1.0:1787432795.277357:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588474496 00000100:00100000:1.0:1787432795.277418:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 47 00000100:00100000:1.0:1787432795.277438:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+27:15690:x1874258588474496:12345-192.168.204.24@tcp:58:dd.0 00010000:00010000:1.0:1787432795.277540:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948302691400/0xca72b3b3356403f3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.277557:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302691400/0xca72b3b3356403f3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.277568:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302691400/0xca72b3b3356403f3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787432795.278970:0:17155:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787432795.279414:0:17155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787432795.279558:0:17155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787432795.279658:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+27:15690:x1874258588474496:12345-192.168.204.24@tcp:58:dd.0 Request processed in 2217us (2513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432795.279669:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 47 00000100:00100000:1.0:1787432795.283115:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432795.283504:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588474624 00000100:00100000:3.0:1787432795.283514:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588474624 00000100:00100000:2.0:1787432795.283765:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 48 00000100:00100000:2.0:1787432795.283778:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+27:15690:x1874258588474624:12345-192.168.204.24@tcp:101:dd.0 00010000:00010000:2.0:1787432795.283797:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432795.283818:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04000/0xca72b3b3356403fa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d52a1 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.283886:0:17156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948302691400/0xca72b3b3356403f3 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.283898:0:17156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04000/0xca72b3b3356403fa lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52a1 expref: 28 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.283916:0:17156:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff948302691400/0xca72b3b3356403f3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.283929:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04000/0xca72b3b3356403fa lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52a1 expref: 28 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.283944:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:2.0:1787432795.283948:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787432795.283952:0:17156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04000/0xca72b3b3356403fa lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52a1 expref: 28 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.283959:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f04000, rc 0) 00000100:00100000:2.0:1787432795.284122:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+28:15690:x1874258588474624:12345-192.168.204.24@tcp:101:dd.0 Request processed in 347us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432795.284130:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 48 00000040:00080000:0.0:1787432795.723567:0:17189:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787432795.723578:0:17189:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787432795.723624:0:17189:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787432795.723636:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787432795.723785:0:17189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbf480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17189:1874258609522944:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787432795.723880:0:17189:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301e0ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432795.728282:0:17189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbf480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17189:1874258609522944:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787432795.732379:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432795.732681:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588474752 00000100:00100000:3.0:1787432795.732690:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588474752 00000100:00100000:3.0:1787432795.732765:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 49 00000100:00100000:3.0:1787432795.732777:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+28:15691:x1874258588474752:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787432795.732808:0:17154:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787432795.732949:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+28:15691:x1874258588474752:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 173us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432795.732964:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 49 00000100:00100000:1.0:1787432795.743361:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432795.743516:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588474880 00000100:00100000:0.0:1787432795.743526:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588474880 00000100:00100000:0.0:1787432795.743591:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 50 00000100:00100000:0.0:1787432795.743601:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+28:15691:x1874258588474880:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787432795.743690:0:20092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b335640401 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.743707:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b335640401 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.743726:0:20092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b335640401 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.743809:0:20092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b335640408 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.743817:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b335640408 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.743824:0:20092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b335640408 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.743848:0:20092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33564040f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.743857:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33564040f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.743864:0:20092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33564040f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432795.743911:0:20092:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787432795.743916:0:20092:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787432795.743929:0:20092:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33564040f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.743940:0:20092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b335640401 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.743946:0:20092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b335640401 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.743953:0:20092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b335640401 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.743969:0:20092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fce00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432795.743973:0:20092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b335640401 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.743981:0:20092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b335640401 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.743993:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948435964e00) 00010000:00010000:0.0:1787432795.743996:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432795.744000:0:20092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b335640401 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.744007:0:20092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fce00/0xca72b3b335640401 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.744023:0:20092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b335640408 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.744028:0:20092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b335640408 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.744034:0:20092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b335640408 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.744038:0:20092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fdc00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432795.744040:0:20092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b335640408 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.744046:0:20092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b335640408 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.744063:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff948435964800) 00010000:00010000:0.0:1787432795.744066:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432795.744069:0:20092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b335640408 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.744386:0:20092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fdc00/0xca72b3b335640408 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.744405:0:20092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33564040f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.744552:0:20092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33564040f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.744561:0:20092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33564040f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.744566:0:20092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fc200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:0.0:1787432795.744569:0:20092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33564040f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.744574:0:20092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33564040f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.744584:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:0.0:1787432795.744586:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432795.744589:0:20092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33564040f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.744594:0:20092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc200/0xca72b3b33564040f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432795.745051:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+28:15691:x1874258588474880:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 1447us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432795.745061:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 50 00000100:00100000:2.0:1787432795.772326:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432795.772443:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588475136 00000100:00100000:1.0:1787432795.772454:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588475136 00000100:00100000:1.0:1787432795.772523:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 51 00000100:00100000:1.0:1787432795.772534:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+28:15691:x1874258588475136:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432795.772555:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432795.772575:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302691000/0xca72b3b335640416 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d52a8 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.772724:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302690800/0xca72b3b33564041d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.772741:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948302690800/0xca72b3b33564041d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.772751:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948302690800/0xca72b3b33564041d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432795.772762:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787432795.772840:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948302690800/0xca72b3b33564041d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.772849:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302690800/0xca72b3b33564041d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.772855:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302690800/0xca72b3b33564041d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.772873:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302690800 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432795.772878:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302690800/0xca72b3b33564041d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.772900:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302690800/0xca72b3b33564041d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.773520:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:1.0:1787432795.773525:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787432795.773530:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302690800/0xca72b3b33564041d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.773539:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302690800/0xca72b3b33564041d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.773590:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948302691000/0xca72b3b335640416 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52a8 expref: 30 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.773600:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff948435964e00) 00010000:00010000:1.0:1787432795.773602:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787432795.773606:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302691000/0xca72b3b335640416 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52a8 expref: 30 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.773614:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948302691000, rc 0) 00000100:00100000:1.0:1787432795.773821:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+29:15691:x1874258588475136:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1287us (1503us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1787432795.773830:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 51 00000100:00100000:1.0:1787432795.781327:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432795.781428:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588475264 00000100:00100000:2.0:1787432795.781438:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588475264 00000100:00100000:2.0:1787432795.781502:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00100000:2.0:1787432795.781513:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+29:15691:x1874258588475264:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787432795.781557:0:17156:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787432795.781689:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+29:15691:x1874258588475264:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 177us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432795.781697:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00100000:0.0:1787432795.792680:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432795.793437:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588475520 00000100:00100000:2.0:1787432795.793450:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588475520 00000100:00100000:2.0:1787432795.793517:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 53 00000100:00100000:2.0:1787432795.793528:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+29:15691:x1874258588475520:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787432795.793548:0:17155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432795.793568:0:17155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b33564042b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d52af expref: -99 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787432795.794606:0:17155:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:2.0:1787432795.794615:0:17155:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1787432795.795421:0:17155:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1787432795.795638:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05000/0xca72b3b335640432 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.795657:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05000/0xca72b3b335640432 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.795667:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05000/0xca72b3b335640432 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.795746:0:17155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b33564042b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52af expref: 32 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.795767:0:17155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05000/0xca72b3b335640432 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52af expref: 31 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.795791:0:17155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948418e86300) 00010000:00010000:2.0:1787432795.795794:0:17155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432795.795798:0:17155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f05000, rc 0) 00000100:00100000:2.0:1787432795.795887:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+31:15691:x1874258588475520:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2360us (3216us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787432795.795896:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 53 00000100:00100000:1.0:1787432795.800359:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432795.801365:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588475776 00000100:00100000:2.0:1787432795.801377:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588475776 00000100:00100000:2.0:1787432795.801446:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 54 00000100:00100000:2.0:1787432795.801457:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+31:15691:x1874258588475776:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787432795.801518:0:17156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432795.801545:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05000/0xca72b3b335640432 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52af expref: 31 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801564:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948418e86300) 00010000:00010000:2.0:1787432795.801576:0:17156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432795.801598:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640440 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801611:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640440 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801620:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640440 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801644:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640447 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9df762d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801671:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640447 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9df762d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801679:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640447 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9df762d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801732:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640440 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801740:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640440 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801747:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640440 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801753:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f04600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432795.801758:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640440 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801765:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640440 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801774:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948418e86200) 00010000:00010000:2.0:1787432795.801776:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432795.801780:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640440 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801786:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b335640440 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801795:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640447 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9df762d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801810:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640447 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9df762d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801815:0:17156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640447 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9df762d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801819:0:17156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f05600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432795.801823:0:17156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640447 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9df762d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801830:0:17156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640447 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9df762d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801839:0:17156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x9df762d1 (ffff948418e86900) 00010000:00010000:2.0:1787432795.801841:0:17156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432795.801844:0:17156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640447 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9df762d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.801849:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b335640447 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9df762d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432795.802933:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+30:15691:x1874258588475776:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 1469us (2575us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787432795.802945:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 54 00000100:00100000:1.0:1787432795.815281:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432795.816293:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588475904 00000100:00100000:3.0:1787432795.816306:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588475904 00000100:00100000:3.0:1787432795.816376:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 55 00000100:00100000:3.0:1787432795.816387:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+30:15691:x1874258588475904:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432795.816407:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432795.816440:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33564044e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d52b6 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.816491:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f400/0xca72b3b335640455 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.816504:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f400/0xca72b3b335640455 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.816515:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f400/0xca72b3b335640455 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.816623:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b33564044e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52b6 expref: 32 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.816657:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f400/0xca72b3b335640455 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52b6 expref: 31 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.816665:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948435957d00) 00010000:00010000:3.0:1787432795.816668:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787432795.816671:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85f400, rc 0) 00000100:00100000:3.0:1787432795.816875:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+31:15691:x1874258588475904:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 489us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432795.816883:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 55 00000100:00100000:0.0:1787432795.821440:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432795.821540:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588476160 00000100:00100000:2.0:1787432795.821551:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588476160 00000100:00100000:2.0:1787432795.821614:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 56 00000100:00100000:2.0:1787432795.821626:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+31:15691:x1874258588476160:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787432795.822428:0:20092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b33564045c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.822460:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b33564045c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.822472:0:20092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b33564045c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787432795.822638:0:20092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1787432795.822647:0:20092:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 606914481530ns, next at 607914479326ns, rc = 0 00000004:00010000:2.0:1787432795.822709:0:20092:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee6ccb3e reply state 00000000955ffd77 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b33564045c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.822732:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b33564045c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.822739:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948435957d00) 00010000:00010000:2.0:1787432795.822741:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787432795.822745:0:20092:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787432795.822853:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+33:15691:x1874258588476160:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 1227us (1421us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787432795.822870:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 56 00000100:00100000:1.0:1787432795.827285:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432795.828195:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588476288 00000100:00100000:3.0:1787432795.828207:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588476288 00000100:00100000:3.0:1787432795.828277:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 57 00000100:00100000:3.0:1787432795.828289:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+33:15691:x1874258588476288:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432795.828316:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432795.828337:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b335640463 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d52bd expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.828424:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b335640463 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52bd expref: 34 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.828440:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b335640463 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52bd expref: 34 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.828461:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948435957d00) 00010000:00010000:3.0:1787432795.828464:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787432795.828468:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85fe00, rc 0) 00000100:00100000:3.0:1787432795.828536:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+34:15691:x1874258588476288:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 249us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432795.828543:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 57 00000100:00100000:1.0:1787432795.835633:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432795.835783:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588476416 00000100:00100000:2.0:1787432795.835793:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588476416 00000100:00100000:2.0:1787432795.835880:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:2.0:1787432795.835892:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588476416:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787432795.836197:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+6:2403:x1874258588476416:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 275us (542us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787432795.836206:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00080000:0.0:1787432795.838003:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432795.841433:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432795.841690:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588476672 00000100:00100000:2.0:1787432795.841723:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588476672 00000100:00100000:2.0:1787432795.841790:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:2.0:1787432795.841801:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+34:15691:x1874258588476672:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787432795.842589:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+35:15691:x1874258588476672:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 786us (1174us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787432795.842599:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:1.0:1787432795.858421:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432795.858560:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588476928 00000100:00100000:2.0:1787432795.858572:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588476928 00000100:00100000:2.0:1787432795.858649:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 58 00000100:00100000:2.0:1787432795.858661:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+35:15691:x1874258588476928:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787432795.858821:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+35:15691:x1874258588476928:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 162us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432795.858829:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 58 00000100:00100000:1.0:1787432795.862633:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432795.862728:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588477056 00000100:00100000:3.0:1787432795.862738:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588477056 00000100:00100000:3.0:1787432795.862797:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 59 00000100:00100000:3.0:1787432795.862808:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+35:15691:x1874258588477056:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432795.862829:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432795.862850:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f000/0xca72b3b33564046a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d52c4 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.862937:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640471 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.862964:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640471 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.862976:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640471 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432795.863037:0:17154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787432795.863056:0:17154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640471 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.863095:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85f000/0xca72b3b33564046a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52c4 expref: 37 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.863375:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640471 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52c4 expref: 36 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.863385:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948435957d00) 00010000:00010000:3.0:1787432795.863388:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787432795.863391:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94843f85ec00, rc 0) 00000100:00100000:3.0:1787432795.863677:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+36:15691:x1874258588477056:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 868us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432795.863685:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 59 00000100:00100000:1.0:1787432795.871430:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432795.871688:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588477184 00000100:00100000:0.0:1787432795.871698:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588477184 00000100:00100000:0.0:1787432795.871767:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:0.0:1787432795.871778:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+6:2402:x1874258588477184:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432795.871798:0:18661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432795.871820:0:18661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b90af341/0xca72b3b335640478 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d52cb expref: -99 pid: 18661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787432795.871843:0:18661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a0f5b, blocks: 0x0 00010000:00010000:0.0:1787432795.871965:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=606s v=(0 0) 00010000:00010000:0.0:1787432795.871971:0:18661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432795.871982:0:18661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b90af341/0xca72b3b335640478 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52cb expref: 7 pid: 18661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.872002:0:18661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b90af341/0xca72b3b335640478 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52cb expref: 7 pid: 18661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.872015:0:18661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9484013fc800, rc 0) 00000100:00100000:0.0:1787432795.872100:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+7:2402:x1874258588477184:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 324us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432795.872116:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:1.0:1787432795.876882:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432795.877006:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588477440 00000100:00100000:2.0:1787432795.877016:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588477440 00000100:00100000:2.0:1787432795.877084:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 60 00000100:00100000:2.0:1787432795.877095:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+36:15691:x1874258588477440:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787432795.877235:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+36:15691:x1874258588477440:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 141us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432795.877243:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 60 00000100:00100000:1.0:1787432795.885948:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432795.886401:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588477568 00000100:00100000:2.0:1787432795.886421:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588477568 00000100:00100000:2.0:1787432795.886487:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 61 00000100:00100000:2.0:1787432795.886498:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+36:15691:x1874258588477568:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787432795.891081:0:17134:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1787432795.891098:0:17134:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1787432795.891322:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05800/0xca72b3b3356402b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891335:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05800/0xca72b3b3356402b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891342:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05800/0xca72b3b3356402b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891348:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f05800 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432795.891352:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05800/0xca72b3b3356402b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891375:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05800/0xca72b3b3356402b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891392:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff948418e86d00) 00010000:00010000:3.0:1787432795.891415:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432795.891420:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05800/0xca72b3b3356402b1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891426:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05800/0xca72b3b3356402b1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891457:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05200/0xca72b3b3356402b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891464:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05200/0xca72b3b3356402b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891470:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05200/0xca72b3b3356402b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891474:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f05200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432795.891476:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05200/0xca72b3b3356402b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891482:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05200/0xca72b3b3356402b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891490:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948418e86200) 00010000:00010000:3.0:1787432795.891493:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432795.891496:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05200/0xca72b3b3356402b8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891508:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05200/0xca72b3b3356402b8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891522:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e000/0xca72b3b335640360 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891528:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e000/0xca72b3b335640360 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891534:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e000/0xca72b3b335640360 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891539:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432795.891542:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e000/0xca72b3b335640360 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891548:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e000/0xca72b3b335640360 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891557:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff948435957400) 00010000:00010000:3.0:1787432795.891559:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432795.891562:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e000/0xca72b3b335640360 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891568:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e000/0xca72b3b335640360 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891584:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356403e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891590:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356403e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891602:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356403e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891606:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85ee00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432795.891609:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356403e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891616:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356403e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891625:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:3.0:1787432795.891627:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432795.891630:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356403e5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891636:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ee00/0xca72b3b3356403e5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891648:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b33564045c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891654:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b33564045c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891659:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b33564045c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891663:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f05600 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432795.891666:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b33564045c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891696:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b33564045c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891706:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948435957d00) 00010000:00010000:3.0:1787432795.891708:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787432795.891711:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b33564045c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.891725:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05600/0xca72b3b33564045c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787432795.891914:0:17134:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1787432795.892157:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+15:15691:x1874258588477568:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 5655us (6212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432795.892197:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 61 00010000:00010000:3.0:1787432795.893778:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b335640305 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.893789:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b335640305 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.893796:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b335640305 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.893801:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e200 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:3.0:1787432795.893805:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b335640305 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.893812:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b335640305 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.893826:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff948418e86200) 00010000:00010000:3.0:1787432795.893829:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787432795.893832:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b335640305 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.893849:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b335640305 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432795.894292:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432795.894311:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94830456aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609523072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787432795.894373:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432795.894540:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609523072 00000100:00100000:3.0:1787432795.894548:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609523072 00000100:00100000:3.0:1787432795.894603:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787432795.894613:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609523072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787432795.894751:0:18659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787432795.894754:0:18659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787432795.894757:0:18659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787432795.894759:0:18659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787432795 -> 1787432795 00002000:00010000:3.0:1787432795.894761:0:18659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787432795.894805:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1874258609523072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 193us (430us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787432795.894813:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:3.0:1787432795.894859:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94830456aa00/2, rc 0, transno 8589934596 00000100:00100000:3.0:1787432795.894865:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94830456aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609523072:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1787432795.895286:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432795.905886:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432795.905983:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588477696 00000100:00100000:3.0:1787432795.905992:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588477696 00000100:00100000:3.0:1787432795.906051:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 26 00000100:00100000:3.0:1787432795.906063:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405942a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+7:2403:x1874258588477696:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787432795.906226:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405942a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+7:2403:x1874258588477696:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 165us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432795.906235:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 26 00000100:00100000:1.0:1787432795.923238:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432795.923369:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588477952 00000100:00100000:2.0:1787432795.923402:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588477952 00000100:00100000:2.0:1787432795.923475:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 62 00000100:00100000:2.0:1787432795.923488:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+15:15691:x1874258588477952:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787432795.923563:0:20092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432795.923599:0:20092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85ec00/0xca72b3b335640471 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52c4 expref: 15 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.923620:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948435957d00) 00010000:00010000:2.0:1787432795.923625:0:20092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432795.923658:0:20092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564047f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.923671:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564047f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.923691:0:20092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564047f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432795.923837:0:20092:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d13633ab reply state 0000000017c4a1b3 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564047f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.923851:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04600/0xca72b3b33564047f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.923857:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948435957d00) 00010000:00010000:2.0:1787432795.923860:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787432795.923863:0:20092:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787432795.923982:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+16:15691:x1874258588477952:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 496us (755us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787432795.923990:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 62 00000100:00100000:1.0:1787432795.930420:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432795.931011:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588478080 00000100:00100000:3.0:1787432795.931036:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588478080 00000100:00100000:3.0:1787432795.931112:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 27 00000100:00100000:3.0:1787432795.931125:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+7:2403:x1874258588478080:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787432795.931314:0:18659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787432795.931317:0:18659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787432794 00002000:00010000:3.0:1787432795.931320:0:18659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787432794 00002000:00010000:3.0:1787432795.931322:0:18659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787432795 -> 1787432794 00002000:00010000:3.0:1787432795.931324:0:18659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787432795.931404:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+8:2403:x1874258588478080:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 282us (994us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787432795.931419:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 27 00000100:00100000:1.0:1787432795.939403:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432795.939594:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588478208 00000100:00100000:3.0:1787432795.939605:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588478208 00000100:00100000:3.0:1787432795.939670:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 28 00000100:00100000:3.0:1787432795.939681:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+8:2401:x1874258588478208:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787432795.939766:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b335640486 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.939785:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787432795.939789:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432795.939796:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b335640486 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.939812:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b335640486 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.939839:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b335640486 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.939854:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b335640486 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.939861:0:18660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b335640486 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.939868:0:18660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:3.0:1787432795.939872:0:18660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b335640486 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.939881:0:18660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b335640486 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.939897:0:18660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b335640486 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432795.939906:0:18660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7b6af9b/0xca72b3b335640486 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432795.940259:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+8:2401:x1874258588478208:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 578us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432795.940268:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 28 00000100:00100000:0.0:1787432795.946779:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432795.946904:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588478464 00000100:00100000:3.0:1787432795.947057:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588478464 00000100:00100000:0.0:1787432795.947839:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 63 00000100:00100000:0.0:1787432795.947853:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+16:15691:x1874258588478464:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787432795.947963:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b33564048d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.947981:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04a00/0xca72b3b3356403de lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5293 expref: 16 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.947990:0:17154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b33564048d lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.948024:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04a00/0xca72b3b3356403de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5293 expref: 16 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.948038:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04a00/0xca72b3b3356403de lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5293 expref: 16 pid: 20092 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432795.948050:0:17154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d25180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17154:1874258609523200:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787432795.948293:0:17154:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301e0ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432795.951880:0:17154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d25180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17154:1874258609523200:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787432795.951921:0:17154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b33564048d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432795.962890:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432795.963008:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588478592 00000100:00100000:2.0:1787432795.963018:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588478592 00010000:00010000:2.0:1787432795.963071:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04a00/0xca72b3b3356403de lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5293 expref: 17 pid: 20092 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432795.963123:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 19 00000100:00100000:2.0:1787432795.963135:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+17:2402:x1874258588478592:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432795.963150:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432795.963156:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04a00/0xca72b3b3356403de lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5293 expref: 17 pid: 20092 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.963204:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04a00/0xca72b3b3356403de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5293 expref: 17 pid: 20092 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.963227:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04a00/0xca72b3b3356403de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d5293 expref: 17 pid: 20092 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.963244:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:2.0:1787432795.963251:0:17140:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04000/0xca72b3b3356403fa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52a1 expref: 16 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.963261:0:17140:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b33564048d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.963268:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b33564048d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.963276:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b33564048d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.963308:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432795.963370:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+16:2402:x1874258588478592:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 237us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432795.963388:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 19 00010000:00010000:0.0:1787432795.966968:0:17154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b33564048d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.966986:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b33564048d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.967276:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b335640494 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.967294:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b335640463 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52bd expref: 16 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.967303:0:17154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b335640494 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.967342:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b335640463 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52bd expref: 16 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.967358:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b335640463 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52bd expref: 16 pid: 17154 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432795.967373:0:17154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948409d25880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17154:1874258609523328:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787432795.967737:0:17154:0:(client.c:2715:ptlrpc_set_wait()) set ffff948301e0b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432795.971077:0:17154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948409d25880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17154:1874258609523328:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787432795.971121:0:17154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b335640494 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432795.973078:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432795.973369:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588478720 00000100:00100000:0.0:1787432795.973388:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588478720 00010000:00010000:0.0:1787432795.973433:0:18685:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b335640463 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52bd expref: 17 pid: 17154 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432795.973490:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00100000:0.0:1787432795.973502:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405941500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+17:2403:x1874258588478720:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432795.973521:0:18685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432795.973528:0:18685:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b335640463 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52bd expref: 17 pid: 17154 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.973542:0:18685:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b335640463 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52bd expref: 17 pid: 17154 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.973565:0:18685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85fe00/0xca72b3b335640463 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52bd expref: 17 pid: 17154 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.973583:0:18685:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948435957d00) 00010000:00010000:0.0:1787432795.973588:0:18685:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b335640494 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.973599:0:18685:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b335640494 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.973607:0:18685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b335640494 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432795.973983:0:18685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432795.974127:0:17154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b335640494 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.974136:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b335640494 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787432795.974283:0:17154:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1787432795.974427:0:17154:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1787432795.974474:0:17154:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1787432795.974551:0:17154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17154:1874258609523456:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787432795.974602:0:17154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432795.974743:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405941500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+19:2403:x1874258588478720:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 1242us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432795.974753:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00100000:1.0:1787432795.975109:0:17154:0:(client.c:2715:ptlrpc_set_wait()) set ffff948435bf1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432795.975385:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609523456 00000100:00100000:3.0:1787432795.975402:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609523456 00000100:00100000:3.0:1787432795.975453:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787432795.975462:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17154:x1874258609523456:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787432795.975552:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17154:x1874258609523456:12345-0@lo:1000:mdt00_000.0 Request processed in 91us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432795.975559:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787432795.977828:0:17154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17154:1874258609523456:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787432795.978051:0:17154:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1787432795.978388:0:17154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17154:1874258609523584:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787432795.978461:0:17154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432795.978539:0:17154:0:(client.c:2715:ptlrpc_set_wait()) set ffff948435bf1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787432795.985927:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609523584 00000100:00100000:0.0:1787432795.985970:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609523584 00000100:00100000:0.0:1787432795.986268:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787432795.986281:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17154:x1874258609523584:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787432795.986507:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17154:x1874258609523584:12345-0@lo:1000:mdt00_000.0 Request processed in 229us (8044us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1787432795.986515:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787432795.986611:0:17154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405943480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17154:1874258609523584:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787432795.986669:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b335640494 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.986681:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b335640494 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.986688:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b335640494 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.986694:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fd400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432795.986698:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b335640494 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.986705:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b335640494 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.986731:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948435957d00) 00010000:00010000:1.0:1787432795.986734:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787432795.986739:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b335640494 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.986758:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fd400/0xca72b3b335640494 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.986792:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948302691400/0xca72b3b3356403f3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.986798:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948302691400/0xca72b3b3356403f3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.986803:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948302691400/0xca72b3b3356403f3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.986808:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302691400 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:1.0:1787432795.986811:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302691400/0xca72b3b3356403f3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.986817:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948302691400/0xca72b3b3356403f3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.986825:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:1.0:1787432795.986828:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787432795.986835:0:17154:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04000/0xca72b3b3356403fa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52a1 expref: 19 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.986845:0:17154:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04000/0xca72b3b3356403fa lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52a1 expref: 19 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.986854:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04000/0xca72b3b3356403fa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52a1 expref: 19 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432795.986922:0:17154:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04000/0xca72b3b3356403fa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52a1 expref: 19 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432795.986938:0:17154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405940380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17154:1874258609523712:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787432795.987030:0:17154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358e1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432795.993070:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432795.993339:0:17154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405940380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17154:1874258609523712:192.168.204.24@tcp:105: 00010000:00010000:2.0:1787432795.993367:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948302691400/0xca72b3b3356403f3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.993388:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948302691400/0xca72b3b3356403f3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.993426:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b33564049b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.993439:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b33564049b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.993451:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b33564049b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.993462:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b33564049b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.993468:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b33564049b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.993474:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b33564049b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.993495:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948301f04e00 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432795.993513:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b33564049b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.993520:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b33564049b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.993532:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:2.0:1787432795.993535:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432795.993539:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b33564049b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.993545:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04e00/0xca72b3b33564049b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.993555:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b33564048d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.993561:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b33564048d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.993566:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b33564048d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.993571:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9484013fc000 already unused, calling callback (ffffffffc183f4f0) 00010000:00010000:2.0:1787432795.993574:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b33564048d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.993579:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b33564048d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.993586:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:2.0:1787432795.993589:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787432795.993600:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b33564048d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.993606:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9484013fc000/0xca72b3b33564048d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432795.994206:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+19:15691:x1874258588478464:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 46353us (47433us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787432795.994218:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 63 00000020:00080000:2.0:1787432795.994224:0:17154:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787432795.994735:0:17189:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787432795.994739:0:17189:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787432795.994755:0:17189:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787432795.994761:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787432795.997147:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588478848 00000100:00100000:3.0:1787432795.997161:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588478848 00000100:00100000:3.0:1787432795.997251:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 10 00000100:00100000:3.0:1787432795.997262:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9483030bd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+19:15690:x1874258588478848:12345-192.168.204.24@tcp:49:dd.0 00000100:00100000:3.0:1787432795.997411:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9483030bd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+19:15690:x1874258588478848:12345-192.168.204.24@tcp:49:dd.0 Request processed in 147us (4347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432795.997418:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 10 00000100:00100000:1.0:1787432796.004853:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787432796.005359:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588479104 00000100:00100000:3.0:1787432796.005370:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588479104 00000100:00100000:3.0:1787432796.005457:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 11 00000100:00100000:3.0:1787432796.005469:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948405942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+19:15691:x1874258588479104:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787432796.005767:0:17157:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787432796.005797:0:17157:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1787432796.005831:0:17157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356404a2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432796.005848:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356404a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432796.005860:0:17157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356404a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432796.005888:0:17157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356404a2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432796.005896:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356404a2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432796.005902:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356404a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432796.005932:0:17157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787432796.007569:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432796.007581:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356404a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432796.007591:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94843f85e200 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:0.0:1787432796.007618:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356404a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432796.007636:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356404a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432796.007654:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff948435957d00) 00010000:00010000:0.0:1787432796.007657:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787432796.007662:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356404a2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432796.007668:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94843f85e200/0xca72b3b3356404a2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432796.007684:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432796.007686:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432796.007688:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432796.008047:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948405942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17ee1936-2707-48b4-a113-f80e95ac94b4+21:15691:x1874258588479104:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 2575us (3199us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787432796.008059:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 11 00000020:00080000:3.0:1787432796.008067:0:17157:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787432796.017730:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432796.017829:0:20092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588479232 00000100:00100000:2.0:1787432796.017841:0:20092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588479232 00000100:00100000:2.0:1787432796.017933:0:20092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 64 00000100:00100000:2.0:1787432796.017945:0:20092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948409d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+21:15690:x1874258588479232:12345-192.168.204.24@tcp:101:dd.0 00010000:00010000:2.0:1787432796.017978:0:20092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432796.017999:0:20092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05000/0xca72b3b3356404a9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3eca2d79a6d52d2 expref: -99 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432796.018050:0:20092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04a00/0xca72b3b3356404b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432796.018065:0:20092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04a00/0xca72b3b3356404b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432796.018077:0:20092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04a00/0xca72b3b3356404b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432796.018237:0:20092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff948301f05000/0xca72b3b3356404a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52d2 expref: 23 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432796.018255:0:20092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff948301f04a00/0xca72b3b3356404b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52d2 expref: 22 pid: 20092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432796.018271:0:20092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff948435957600) 00010000:00010000:2.0:1787432796.018274:0:20092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787432796.018278:0:20092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff948301f04a00, rc 0) 00000100:00100000:2.0:1787432796.018340:0:20092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948409d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17ee1936-2707-48b4-a113-f80e95ac94b4+22:15690:x1874258588479232:12345-192.168.204.24@tcp:101:dd.0 Request processed in 397us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432796.018348:0:20092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 64 00000100:00100000:2.0:1787432796.275226:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432796.275266:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787432796.275406:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588479360 00000100:00100000:0.0:1787432796.275418:0:18665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588479360 00000100:00100000:0.0:1787432796.275634:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588479488 00000100:00100000:0.0:1787432796.275638:0:18665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588479488 00000100:00100000:1.0:1787432796.276039:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:1.0:1787432796.276051:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+9:2402:x1874258588479360:12345-192.168.204.24@tcp:4:dd.0 00010000:00010000:1.0:1787432796.276091:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041d398b5/0xca72b3b3356404b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.276113:0:18666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b90af341/0xca72b3b335640478 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52cb expref: 9 pid: 18661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.276122:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432796.276127:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432796.276131:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041d398b5/0xca72b3b3356404b7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.276214:0:18666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b90af341/0xca72b3b335640478 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52cb expref: 9 pid: 18661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.276240:0:18666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b90af341/0xca72b3b335640478 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52cb expref: 9 pid: 18661 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432796.276256:0:18666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405940380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:18666:1874258609523840:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787432796.276343:0:18666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9484358e1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787432796.286673:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787432796.286975:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588479616 00000100:00100000:1.0:1787432796.286985:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588479616 00010000:00010000:1.0:1787432796.287027:0:17140:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b90af341/0xca72b3b335640478 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52cb expref: 10 pid: 18661 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432796.287067:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:1.0:1787432796.287077:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303adb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+10:2403:x1874258588479616:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432796.287091:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432796.287113:0:17140:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b90af341/0xca72b3b335640478 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52cb expref: 10 pid: 18661 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.287127:0:17140:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b90af341/0xca72b3b335640478 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52cb expref: 10 pid: 18661 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.287151:0:17140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432796.287156:0:17140:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432796.287187:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041d398b5/0xca72b3b3356404b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.287218:0:17140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041d398b5/0xca72b3b3356404b7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.287239:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432796.287292:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303adb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17ee1936-2707-48b4-a113-f80e95ac94b4+10:2403:x1874258588479616:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 216us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432796.287301:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 21 00010000:00010000:2.0:1787432796.287957:0:18666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b90af341/0xca72b3b335640478 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0xc3eca2d79a6d52cb expref: 9 pid: 18661 timeout: 707 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432796.287974:0:18666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405940380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:18666:1874258609523840:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787432796.287996:0:18666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000041d398b5/0xca72b3b3356404b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432796.288006:0:18666:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000041d398b5/0xca72b3b3356404b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432796.288012:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041d398b5/0xca72b3b3356404b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.299548:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787432796.416688:0:19475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1787432796.416714:0:19475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1787432796.416977:0:18666:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1787432796.416983:0:18666:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1787432794 -> 1787432795 00002000:00010000:1.0:1787432796.416986:0:18666:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787432794 -> 1787432795 00002000:00010000:1.0:1787432796.416988:0:18666:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1787432796.417006:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041d398b5/0xca72b3b3356404b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.417018:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041d398b5/0xca72b3b3356404b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.417027:0:18666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041d398b5/0xca72b3b3356404b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.417034:0:18666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302691400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432796.417039:0:18666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041d398b5/0xca72b3b3356404b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.417049:0:18666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041d398b5/0xca72b3b3356404b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.417083:0:18666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041d398b5/0xca72b3b3356404b7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.417091:0:18666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041d398b5/0xca72b3b3356404b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432796.417246:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+6:2402:x1874258588479360:12345-192.168.204.24@tcp:4:dd.0 Request processed in 141192us (142025us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787432796.417258:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 0 00000100:00100000:1.0:1787432796.417290:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1 00000100:00100000:1.0:1787432796.417302:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2402:x1874258588479488:12345-192.168.204.24@tcp:4:dd.0 00002000:00010000:1.0:1787432796.417339:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a8a0f5b, atime: 0x6a8a0f5a, ctime: 0x6a8a0f5b, blocks: 0x2000 00010000:00010000:1.0:1787432796.417346:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004f8b23d/0xca72b3b3356404be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.417357:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=607s v=(0 0) 00010000:00010000:1.0:1787432796.417362:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432796.417368:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004f8b23d/0xca72b3b3356404be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.417380:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004f8b23d/0xca72b3b3356404be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787432796.480406:0:19475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1787432796.480971:0:18666:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:1.0:1787432796.480977:0:18666:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:1.0:1787432796.481007:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004f8b23d/0xca72b3b3356404be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.481019:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004f8b23d/0xca72b3b3356404be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.481027:0:18666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004f8b23d/0xca72b3b3356404be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.481031:0:18666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff948302690400 already unused, calling callback (ffffffffc0c32230) 00010000:00010000:1.0:1787432796.481035:0:18666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004f8b23d/0xca72b3b3356404be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.481041:0:18666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004f8b23d/0xca72b3b3356404be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.481055:0:18666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004f8b23d/0xca72b3b3356404be lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432796.481060:0:18666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004f8b23d/0xca72b3b3356404be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432796.481529:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2402:x1874258588479488:12345-192.168.204.24@tcp:4:dd.0 Request processed in 63848us (205879us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787432796.481541:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1 00000100:00100000:2.0:1787432796.621004:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948405940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609523968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432796.621090:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432796.621155:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609523968 00000100:00100000:2.0:1787432796.621193:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609523968 00000100:00100000:2.0:1787432796.621245:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787432796.621255:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609523968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787432796.621277:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:3.0:1787432796.621286:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609524352:0@lo:400:kworker.0 00000100:00100000:3.0:1787432796.621314:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432796.621316:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1874258609523968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432796.621322:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787432796.621331:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609524864:0@lo:400:kworker.0 00000100:00100000:2.0:1787432796.621349:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948301dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609524480:0@lo:400:kworker.0 00000100:00100000:3.0:1787432796.621352:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432796.621442:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3644:1874258609524096:0@lo:400:kworker.0 00000100:00080000:1.0:1787432796.621532:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432796.621561:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609524864 00000100:00100000:1.0:1787432796.621571:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609524864 00000100:00100000:1.0:1787432796.621618:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787432796.621637:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609524864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432796.626553:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609525376:0@lo:400:kworker.0 00000100:00100000:3.0:1787432796.627025:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432796.627078:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787432796.627086:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609524224:0@lo:400:kworker.0 00000100:00100000:3.0:1787432796.627116:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432796.627781:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609524736:0@lo:400:kworker.0 00000100:00100000:3.0:1787432796.627814:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432796.627838:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609525248:0@lo:400:kworker.0 00000100:00100000:3.0:1787432796.627857:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432796.627913:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609524224 00000100:00100000:3.0:1787432796.627921:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609524224 00000100:00100000:3.0:1787432796.627972:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787432796.627981:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609524224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432796.628043:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609524224:12345-0@lo:400:kworker.0 Request processed in 63us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432796.628050:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787432796.628076:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609524352 00000100:00100000:3.0:1787432796.628080:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609524352 00000100:00100000:3.0:1787432796.628121:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609524736 00000100:00100000:3.0:1787432796.628124:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609524736 00000100:00100000:3.0:1787432796.628155:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432796.628182:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609524352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432796.628217:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874258609524352:12345-0@lo:400:kworker.0 Request processed in 56us (6902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432796.628224:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432796.628238:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787432796.628245:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609524736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432796.628272:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609524736:12345-0@lo:400:kworker.0 Request processed in 28us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432796.628278:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1787432796.628300:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432796.628335:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609524224:0@lo:400:kworker.0 00000100:00100000:3.0:1787432796.628358:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609524736:0@lo:400:kworker.0 00000100:00100000:3.0:1787432796.628369:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1874258609524352:0@lo:400:kworker.0 00000100:00100000:3.0:1787432796.628460:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609525376 00000100:00100000:3.0:1787432796.628465:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609525376 00000100:00080000:3.0:1787432796.628481:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787432796.628498:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609525248 00000100:00100000:3.0:1787432796.628500:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609525248 00000100:00080000:3.0:1787432796.628511:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432796.628523:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787432796.628530:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609525376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432796.628567:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874258609525376:12345-0@lo:400:kworker.0 Request processed in 38us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432796.628573:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1787432796.628611:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f940000 x1874258609525376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432796.628621:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1874258609525376:0@lo:400:kworker.0 00000100:00100000:3.0:1787432796.628636:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787432796.628643:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94843f940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609525248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432796.628676:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874258609525248:12345-0@lo:400:kworker.0 Request processed in 34us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432796.628681:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787432796.628725:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1874258609525248:0@lo:400:kworker.0 00000100:00100000:2.0:1787432796.644721:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432796.644795:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609524992:0@lo:400:kworker.0 00000100:00100000:3.0:1787432796.644814:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609524480 00000100:00100000:3.0:1787432796.644822:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609524480 00000100:00100000:2.0:1787432796.644853:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432796.644879:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609524992 00000100:00100000:3.0:1787432796.644896:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609524992 00000100:00100000:2.0:1787432796.644916:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948405940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1874258609523968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787432796.644940:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f91bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609525504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432796.644943:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787432796.644952:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609524480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432796.644966:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432796.644988:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609525504 00000100:00100000:2.0:1787432796.644992:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609525504 00000100:00100000:3.0:1787432796.645000:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874258609524480:12345-0@lo:400:kworker.0 Request processed in 49us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432796.645007:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787432796.645018:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787432796.645022:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787432796.645024:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609525504:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432796.645027:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609524992:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1787432796.645037:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:3.0:1787432796.645052:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874258609524992:12345-0@lo:400:kworker.0 Request processed in 25us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432796.645058:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787432796.645064:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609525504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432796.645070:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787432796.645076:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432796.645092:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1787432796.645097:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94830456aa00, transno 8589934596 00000004:00080000:2.0:1787432796.645122:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1787432796.645142:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f91bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609525504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432796.645184:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948301dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874258609524480:0@lo:400:kworker.0 00000100:00100000:2.0:1787432796.645195:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1874258609524992:0@lo:400:kworker.0 00000100:00100000:0.0:1787432796.648407:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432796.648478:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609524608:0@lo:400:kworker.0 00000100:00100000:0.0:1787432796.648529:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432796.648568:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609524608 00000100:00100000:0.0:1787432796.648585:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609524608 00000100:00100000:3.0:1787432796.648590:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609524096 00000100:00100000:3.0:1787432796.648594:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609524096 00000100:00100000:3.0:1787432796.648636:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787432796.648636:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787432796.648645:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3644:x1874258609524096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432796.648645:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609524608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432796.648691:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609524608:12345-0@lo:400:kworker.0 Request processed in 47us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432796.648707:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787432796.648709:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b+24:3644:x1874258609524096:12345-0@lo:400:kworker.0 Request processed in 67us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432796.648715:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787432796.648751:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609524608:0@lo:400:kworker.0 00000100:00100000:0.0:1787432796.648759:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609525120:0@lo:400:kworker.0 00000100:00100000:0.0:1787432796.648785:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432796.648821:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609525120 00000100:00100000:3.0:1787432796.648826:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609525120 00000100:00100000:0.0:1787432796.648841:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948303adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a17b1bee-bf1a-4170-8e2c-9ac5bfd8c03b:3644:1874258609524096:0@lo:400:kworker.0 00000100:00100000:3.0:1787432796.648861:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787432796.648868:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609525120:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787432796.648879:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787432796.648925:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874258609525120:12345-0@lo:400:kworker.0 Request processed in 57us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432796.648931:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1787432796.649357:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94843f943800 x1874258609525120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432796.649381:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1874258609525120:0@lo:400:kworker.0 00000100:00100000:1.0:1787432796.651417:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94843f942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874258609524864:12345-0@lo:400:kworker.0 Request processed in 29772us (30053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432796.651434:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787432796.655344:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874258609524864:0@lo:400:kworker.0 00010000:00010000:2.0:1787432797.323377:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432797.651562:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432797.651587:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609525632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432797.651657:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432797.651727:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609525632 00000100:00100000:0.0:1787432797.651750:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609525632 00000100:00100000:0.0:1787432797.651803:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787432797.651813:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609525632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432797.651857:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787432797.651904:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1874258609525632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432797.651911:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787432797.651955:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1874258609525632:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787432798.197137:0:20332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1787432798.237710:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432798.237761:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432798.237790:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432798.237810:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432798.237834:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432798.237851:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432798.237866:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432798.237881:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432798.237918:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787432798.237946:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588479872 00000100:00100000:1.0:1787432798.237946:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588480128 00000100:00100000:2.0:1787432798.237956:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588479872 00000100:00100000:1.0:1787432798.237956:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588480128 00000100:00100000:1.0:1787432798.238016:0:19127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588480640 00000100:00100000:1.0:1787432798.238019:0:19127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588480640 00000100:00100000:0.0:1787432798.238067:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588480384 00000100:00100000:0.0:1787432798.238072:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588480384 00000100:00100000:2.0:1787432798.238115:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588480000 00000100:00100000:2.0:1787432798.238118:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588480000 00000100:00100000:2.0:1787432798.238128:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588480512 00000100:00100000:2.0:1787432798.238130:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588480512 00000100:00100000:2.0:1787432798.238144:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 69 00000100:00100000:2.0:1787432798.238152:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+22:2403:x1874258588479872:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432798.238247:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+22:2403:x1874258588479872:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 95us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432798.238266:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 69 00000100:00100000:2.0:1787432798.238282:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 70 00000100:00100000:2.0:1787432798.238289:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588480000:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432798.238311:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588480000:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432798.238327:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 70 00000100:00100000:2.0:1787432798.238348:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 71 00000100:00100000:2.0:1787432798.238355:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2403:x1874258588480512:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432798.238784:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2403:x1874258588480512:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 428us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432798.238791:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 71 00000100:00100000:2.0:1787432798.238814:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588480256 00000100:00100000:2.0:1787432798.238818:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588480256 00000100:00100000:2.0:1787432798.238837:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588480768 00000100:00100000:2.0:1787432798.238841:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588480768 00000100:00100000:2.0:1787432798.238855:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 28 00000100:00100000:2.0:1787432798.238861:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588480128:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432798.238887:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588480128:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432798.238893:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 28 00000100:00100000:2.0:1787432798.238915:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 29 00000100:00100000:2.0:1787432798.238922:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588480256:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432798.238945:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17ee1936-2707-48b4-a113-f80e95ac94b4+5:2403:x1874258588480256:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432798.238952:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 29 00000100:00100000:2.0:1787432798.238963:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 30 00000100:00100000:2.0:1787432798.238970:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2403:x1874258588480768:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432798.238991:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2403:x1874258588480768:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 22us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432798.239006:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 30 00000100:00100000:2.0:1787432798.239026:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258588479744 00000100:00100000:2.0:1787432798.239031:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258588479744 00000100:00100000:2.0:1787432798.239061:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 169 00000100:00100000:2.0:1787432798.239069:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948303651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:2403:x1874258588479744:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787432798.239102:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948303651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15916cf8-04d2-4c09-9229-fbbbb74d56ef+13:2403:x1874258588479744:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 35us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432798.239109:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 169 00000100:00100000:1.0:1787432798.242866:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 31 00000100:00100000:1.0:1787432798.242882:0:19127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2403:x1874258588480640:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432798.243014:0:19127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fd65f33-d046-43bb-9119-74a1dce1ebb4+5:2403:x1874258588480640:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 135us (5201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432798.243069:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 31 00000100:00080000:1.0:1787432798.243104:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432798.243109:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787432798.243112:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432798.243115:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432798.248683:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 72 00000100:00100000:1.0:1787432798.248701:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94830456aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2403:x1874258588480384:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787432798.248805:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94830456aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fd65f33-d046-43bb-9119-74a1dce1ebb4+6:2403:x1874258588480384:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 109us (11012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432798.248814:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 72 00010000:00010000:0.0:1787432798.347283:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432798.667507:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff948304463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609525760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787432798.667583:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432798.667707:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609525760 00000100:00100000:1.0:1787432798.667731:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609525760 00000100:00100000:1.0:1787432798.667791:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787432798.667811:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609525760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787432798.667847:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787432798.667908:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874258609525760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432798.667916:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787432798.667962:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff948304463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1874258609525760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787432798.669852:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609525888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432798.669937:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432798.670317:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609525888 00000100:00100000:3.0:1787432798.670334:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609525888 00000100:00100000:3.0:1787432798.670394:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787432798.670404:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948304568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609525888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787432798.670437:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1787432798.670481:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948304568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874258609525888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432798.670488:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787432798.670783:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1874258609525888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787432798.672371:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432798.672392:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94843f918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609526016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787432798.672457:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432798.672817:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258609526016 00000100:00100000:1.0:1787432798.672824:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258609526016 00000100:00100000:1.0:1787432798.672889:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787432798.672907:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff948301dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609526016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787432798.672932:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787432798.672988:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff948301dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874258609526016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432798.672995:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432798.673073:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94843f918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1874258609526016:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787432798.673157:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787432799.374522:0:19769:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787432799.821006:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 Debug log: 43060 lines, 43060 kept, 0 dropped, 0 bad.